Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consolidate gpu environment logic in buildenv #32

Merged
merged 2 commits into from
Dec 17, 2021

Conversation

mcgibbon
Copy link
Contributor

@mcgibbon mcgibbon commented Dec 17, 2021

Infrastructure changes:

  • G2G is removed as an argument for run_command
  • DOCKER_BUILDKIT=1 is set in buildenv, not pace
  • PYTHONOPTIMIZE=TRUE is set in run_on_daint.sh, not in the slurm script
  • updated pace-util jenkins.sh to match buildenv run_command api

Linked to ai2cm/pace#76

env.daint.sh Outdated
@@ -12,6 +12,7 @@ module load Boost/1.70.0-CrayGNU-20.11-python3
module load cudatoolkit/11.2.0_3.39-2.1__gf93aa1c
module load graphviz/2.44.0
module load /project/s1053/install/modulefiles/gcloud/303.0.0
module load nvidia-nsight-systems/2021.1.1.66-6c5c5cb
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This isn't required to run GPU and shouldn't be loaded by default

Copy link
Contributor

@FlorianDeconinck FlorianDeconinck left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One minor change and we are good

@mcgibbon mcgibbon marked this pull request as ready for review December 17, 2021 23:10
mcgibbon added a commit to ai2cm/pace that referenced this pull request Dec 17, 2021
## Purpose

run_command currently takes a G2G argument we have hard-coded to always be false. This PR removes that argument, and moves several environment variables from pace into buildenv.

Depends on ai2cm/buildenv#32.

## Infrastructure changes:

- G2G is removed as an argument for run_command
- DOCKER_BUILDKIT=1 is set in buildenv, not pace
- PYTHONOPTIMIZE=TRUE is set in run_on_daint.sh, not in the slurm script
- updated pace-util jenkins.sh to match buildenv run_command api
@mcgibbon mcgibbon merged commit 88465c1 into master Dec 17, 2021
@mcgibbon mcgibbon deleted the feature/move_g2g_to_buildenv branch December 17, 2021 23:10
export MPICH_G2G_PIPELINE=256
export MPICH_NEMESIS_ASYNC_PROGRESS=1
export MPICH_MAX_THREAD_SAFETY=multiple
export DOCKER_BUILDKIT=1
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this doesn't make sense in env.daint.sh, there is no docker there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants