v0.22.0

What's New

🔥 Support for PyTorch v2.3.0

Composer now supports the recently-released PyTorch version 2.3.0! Please raise any issues with us so we can address them.

Bug Fixes

• Fixing checks for device microbatch size for sequence parallelism in #3200
• Fixing token logging in #3206
• Search for run name in MLFlowLogger in #3215
• Fix FQN names with activation checkpointing in #3210
• Strict weight matching for checkpoint loading in #3219

What's Changed

• Bump transformers by @dakinggg in #3197
• Add deprecation warnings for ICL datasets/helper functions/metrics by @bmosaicml in #3125
• Bump traitlets from 5.14.2 to 5.14.3 by @dependabot in #3204
• Raise LR schedule warnings only when necessary by @snarayan21 in #3207
• Add torch 2.3 support by @mvpatel2000 in #3209
• Add torch 2.3 CI/CD by @mvpatel2000 in #3211
• Fix daily test images by @mvpatel2000 in #3212
• Try FAv2 2.5.7 from source by @mvpatel2000 in #3213
• Update tests by @mvpatel2000 in #3217
• Fix torch 2.3 GPU tests by @mvpatel2000 in #3218
• Use flash-attn 2.5.8 with no build isolation in docker images by @snarayan21 in #3224
• Add a torch.cuda.empty_cache() in utils.save_checkpoint by @bfontain in #3216
• Require 2 steps for GS object store by @mvpatel2000 in #3228
• Add rename_metrics to Mlflow logger by @hanlint in #3225
• Fix daily tests by @mvpatel2000 in #3229
• Change precision for daily tests by @mvpatel2000 in #3231
• Create new Mlflow run by default and introduce run_group by @chenmoneygithub in #3208
• Fix daily test pt 4 by @mvpatel2000 in #3233
• Deprecate and bump version to 0.22 by @mvpatel2000 in #3230
• Fix daily tests v5 by @mvpatel2000 in #3234
• Fix daily v6 by @mvpatel2000 in #3235
• fix daily tests v7 by @mvpatel2000 in #3236
• Raise the daily test timeout by @dakinggg in #3241
• Accelerate GPU tests by @mvpatel2000 in #3237
• Make sharded checkpoint loading backwards-compatible by @snarayan21 in #3240

Full Changelog: v0.21.3...v0.22.0