Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jetstream v1.7.4 #172

Merged
merged 21 commits into from Nov 28, 2023
Merged

Jetstream v1.7.4 #172

merged 21 commits into from Nov 28, 2023

Conversation

bryce-turner
Copy link
Member

Jetstream v1.7.4 Release Notes

Major changes

  • Improved pipeline version parsing to use PEP440 style versioning - development and latest have been added as aliases to the latest development and stable release respectively.
    • Pipelines and their version now have a defined comparison format, e.g. defining __lt__ and __eq__ functions, this allows for a sorted pipeline list.
  • Improved handling support of JS_PIPELINE_PATH both within template via the expand_vars function and within the slurm_singularity backend.

Bug fixes

  • The slurm_singularity backend has improved search functionality for finding cached images, previously only found cached images if the digest was explicitly defined for the task.
  • Avoid erroneously attempting to bind $JS_PIPELINE_PATH if it has not been set, e.g. if the user is simply running jetstream run without any pipeline context.

Minor changes

  • Linting related adjustments to the slurm_singularity.py backend.
  • Limiting the networkx version range to exclude the 3.0 release for now.

bryce-turner and others added 21 commits October 10, 2023 13:03
…imilar labels as an alias to grabbing the most recent pipeline version

This allows us to be able to request "pipeline@1.0.0.dev1" via "pipeline@development".
Additionally if "pipeline@development" does exist in the search path, it is considered as the most recent version.
… and we can say that v1.0.0 is logically equivalent to 1.0.0 when a user requests pipeline@1.0.0
…re SIGPIPE friendly. These changes allow for a cleaner output from `jetstream pipelines -v pipeline@v1.0.0 | head`.
…ld be more SIGPIPE friendly. These changes allow for a cleaner output from `jetstream pipelines -v pipeline@v1.0.0 | head`."

This reverts commit af24a18. Previous commit failed pytest and this isn't in the scope of the features for this branch.
…his allows us to search for cached images without necessarily looking for the digest
…pretting $JS_PIPELINE_PATH and replace this with the context value since JS_PIPELINE_PATH isn't in the env until runtime
Updates to follow pep 440 versioning for pipelines
Bug fix for binding JS_PIPELINE_PATH differences between run and pipelines
…s follows the expected path in both default and set cases
Fix for SINGULARITY_CACHEDIR usage, this follows the expected path in both default and set cases
…tup_py

Small update to slurm_singularity's auto gpu detection and configuring setup.py to use networkx>=2.6,<3
@PedalheadPHX PedalheadPHX self-requested a review November 28, 2023 23:12
@PedalheadPHX PedalheadPHX marked this pull request as ready for review November 28, 2023 23:12
Copy link
Member

@PedalheadPHX PedalheadPHX left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Changes look good

@PedalheadPHX PedalheadPHX merged commit f9594f7 into master Nov 28, 2023
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants