Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

v1.7.3 release #160

Merged
merged 23 commits into from Sep 19, 2023
Merged

v1.7.3 release #160

merged 23 commits into from Sep 19, 2023

Conversation

bryce-turner
Copy link
Member

@bryce-turner bryce-turner commented Sep 18, 2023 •
edited

Depends on #159

Release notes:

Jetstream v1.7.3 Release Notes

Major changes

  • For slurm backends, the sacct pinginess has been reduced, and we request less information instead of --all, this reduces load on the slurmdbd
  • The slurm_singularity backend can now submit jobs without a container definition
  • Added an md5 and assignbin filter for using in templates

Bug fixes

Minor changes

  • Adjusted handling of gpu jobs for the slurm_singularity backend, we now set SINGULARITYENV_CUDA_VISIBLE_DEVICES

Ease of use updates

  • A bash completion script is available under extras/completions/jetstream.bash, this is still in development, but can be used as a template for other users. This can be installed under ~/.bash_completion or to your preferred user completion script dir, e.g. ~/.local/share/bash-completion/completions/jetstream.bash

bryce-turner and others added 20 commits January 23, 2023 12:44
@bryce-turner
Merge pull request #157 from tgen/master
3d661ab 
Sync develop and main branches
@bryce-turner
Letting mash default to replacing the existing workflow if output is …
e562cb1 
…not defined
@bryce-turner
Adding an md5 template filter to allow for rendering of md5sums of re…
0a6ac36 
…alpaths
@bryce-turner
Adding export of bin_path for use with singularity
2eef3f8
@bryce-turner
Adjustments to reduce slurm pinginess from sacct
79f0294
@bryce-turner
Slurm singularity backend is now able to fallback to a regular slurm …
2851a57 
…submission if the task does define a container directive
@bryce-turner
Simplified input_file_validation setting
d17c827
@bryce-turner
Fixing asyncio.Event(loop) usage
1a9d1de
@bryce-turner
Fixing asyncio.Event(loop) usage, but allowing older python versions
039add6
@bryce-turner
Adding assignbin as a template filter
9da7d1e
@bryce-turner
Fixing sacct_fields usage for slurm backend
1ba52ce
@bryce-turner
Minor syntax adjustments and avoiding bind of paths relative to cwd s…
4bd943a 
…ince we bind PWD anyway
@bryce-turner
Simplifying sbatch script that is generated for handling gpu jobs sin…
867547e 
…ce gpu should be mentioned in the exec args during submission
@bryce-turner
Using packaging==21.3 for legacy pipeline versioning
247f4f1
@bryce-turner
Automatically adding --nv if we think the job is using gpus, but we a…
ea1c1db 
…void adding it if --nv was already set
@PedalheadPHX
Merge pull request #158 from tgen/v1.7.3_features
90c93e5 
Jetstream v1.7.3 features
@bryce-turner
Update documentation for new template filters md5 and assignbin
9c5a3ab
@bryce-turner
Create jetstream.bash completion script
ef57260
@bryce-turner
Create 1.7.3.md
3e2d2d3
@bryce-turner
Version bump to 1.7.3
ce75316
PedalheadPHX
PedalheadPHX approved these changes Sep 19, 2023
View reviewed changes
Copy link
Member

@PedalheadPHX PedalheadPHX left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ready for the next release cycle

@PedalheadPHX PedalheadPHX merged commit 0823bae into master Sep 19, 2023
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PedalheadPHX PedalheadPHX PedalheadPHX approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Pipeline data helper function
2 participants
@bryce-turner @PedalheadPHX