Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/amp #980

Closed
wants to merge 33 commits into from
Closed

Feature/amp #980

wants to merge 33 commits into from

Commits on Aug 18, 2020

  1. Fix runtime warning on pytorch 1.6

    @BloodAxe
    BloodAxe committed Aug 18, 2020
    Configuration menu
    Copy the full SHA
    4f700ba View commit details
    Browse the repository at this point in the history

  2. Convert BN to SyncBN before wrapping model with DDP (Follows the orde… 

    …r in official Apex examples)
    @BloodAxe
    BloodAxe committed Aug 18, 2020
    Configuration menu
    Copy the full SHA
    e815322 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2020

  1. Update distributed.py

    @BloodAxe
    BloodAxe committed Aug 25, 2020
    Configuration menu
    Copy the full SHA
    a8bf0d6 View commit details
    Browse the repository at this point in the history

  2. Update runner.py 

    Replace .shape[0] with len() call which is more compatible with exotic input batches (like for fine-tuning Faster RCNN, which requires sending list of image tensors)
    @BloodAxe
    BloodAxe committed Aug 25, 2020
    Configuration menu
    Copy the full SHA
    64e8154 View commit details
    Browse the repository at this point in the history

  3. Fix codestyle

    @BloodAxe
    BloodAxe committed Aug 25, 2020
    Configuration menu
    Copy the full SHA
    97d2394 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into master

    @BloodAxe
    BloodAxe committed Aug 25, 2020
    Configuration menu
    Copy the full SHA
    41f4c0e View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2020

  1. Merge remote-tracking branch 'master/master'

    @BloodAxe
    BloodAxe committed Aug 26, 2020
    Configuration menu
    Copy the full SHA
    3ceadd7 View commit details
    Browse the repository at this point in the history

  2. Initial commit of the torch.amp support

    @BloodAxe
    BloodAxe committed Aug 26, 2020
    Configuration menu
    Copy the full SHA
    2c3e311 View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2020

  1. Move amp-related import inside AMPOptimizerCallback

    @BloodAxe
    BloodAxe committed Aug 27, 2020
    Configuration menu
    Copy the full SHA
    2ead425 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2020

  1. Implemented gradient scaling & accumulation support

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    7098373 View commit details
    Browse the repository at this point in the history

  2. Fix code-style errors

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    8b7aaf6 View commit details
    Browse the repository at this point in the history

  3. Fix version parsing

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    7912751 View commit details
    Browse the repository at this point in the history

  4. Fix reviewdog errors

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    4d674f6 View commit details
    Browse the repository at this point in the history

  5. Fix reviewdog errors

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    b67a71a View commit details
    Browse the repository at this point in the history

  6. Fix reviewdog errors

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    bacf133 View commit details
    Browse the repository at this point in the history

  7. Fix reviewdog errors

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    1b0a40d View commit details
    Browse the repository at this point in the history

  8. Fix reviewdog errors

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    cbb29cc View commit details
    Browse the repository at this point in the history

  9. Merge branch 'master' into feature/amp

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    08a07ad View commit details
    Browse the repository at this point in the history

  10. Update changelog

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    ade976b View commit details
    Browse the repository at this point in the history

  11. Update comments

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    9b3bdda View commit details
    Browse the repository at this point in the history

  12. Update comments

    @BloodAxe
    BloodAxe committed Sep 1, 2020
    Configuration menu
    Copy the full SHA
    536875c View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2020

  1. Merge remote-tracking branch 'master/master' into feature/amp 

    # Conflicts:
#	CHANGELOG.md
#	catalyst/core/callbacks/optimizer.py
    @BloodAxe
    BloodAxe committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    59e9264 View commit details
    Browse the repository at this point in the history

  2. Add use_fast_zero_grad to AMPOptimizerCallback

    @BloodAxe
    BloodAxe committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    d7410da View commit details
    Browse the repository at this point in the history

  3. Comment torch.backends.quantized.engine = "qnnpack"

    @BloodAxe
    BloodAxe committed Sep 4, 2020
    Configuration menu
    Copy the full SHA
    9c08e28 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2020

  1. Merge remote-tracking branch 'master/master' into feature/amp 

    # Conflicts:
#	catalyst/dl/utils/quantization.py
    @BloodAxe
    BloodAxe committed Sep 11, 2020
    Configuration menu
    Copy the full SHA
    477c441 View commit details
    Browse the repository at this point in the history

  2. Add find_unused_parameters

    @BloodAxe
    BloodAxe committed Sep 11, 2020
    Configuration menu
    Copy the full SHA
    dc5ffdd View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2020

  1. Fix pytorch 1.6 warning on get_last_lr

    @BloodAxe
    BloodAxe committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    dbcf6d7 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'master/master' into feature/amp

    @BloodAxe
    BloodAxe committed Sep 16, 2020
    Configuration menu
    Copy the full SHA
    07279e9 View commit details
    Browse the repository at this point in the history

Commits on Oct 29, 2020

  1. Merge remote-tracking branch 'master/master'

    @BloodAxe
    BloodAxe committed Oct 29, 2020
    Configuration menu
    Copy the full SHA
    bbf10a5 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into feature/amp 

    # Conflicts:
#	catalyst/callbacks/optimizer.py
    @BloodAxe
    BloodAxe committed Oct 29, 2020
    Configuration menu
    Copy the full SHA
    e29166f View commit details
    Browse the repository at this point in the history

  3. Fix wrong import

    @BloodAxe
    BloodAxe committed Oct 29, 2020
    Configuration menu
    Copy the full SHA
    56d24b3 View commit details
    Browse the repository at this point in the history

  4. Updated CHANGELOG.md

    @BloodAxe
    BloodAxe committed Oct 29, 2020
    Configuration menu
    Copy the full SHA
    3ecd7e3 View commit details
    Browse the repository at this point in the history

  5. Fix code style

    @BloodAxe
    BloodAxe committed Oct 29, 2020
    Configuration menu
    Copy the full SHA
    944eab1 View commit details
    Browse the repository at this point in the history