Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flexible and easy to use HSDP setting #19504

Open
wants to merge 23 commits into
base: master
Choose a base branch
from
Open

Flexible and easy to use HSDP setting #19504

wants to merge 23 commits into from

Commits on Jan 17, 2024

  1. Add fsdp_size for FSDPStrategy

    @Liyang90
    Liyang90 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    312caee View commit details
    Browse the repository at this point in the history

  2. fix import

    @Liyang90
    Liyang90 committed Jan 17, 2024
    Configuration menu
    Copy the full SHA
    45c1123 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. Merge branch 'Lightning-AI:master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    0ddc51d View commit details
    Browse the repository at this point in the history

  2. Add flexible HSDP in fabric

    @Liyang90
    Liyang90 committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    c952536 View commit details
    Browse the repository at this point in the history

  3. minor update

    @Liyang90
    Liyang90 committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    8fc2404 View commit details
    Browse the repository at this point in the history

  4. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    da3900f View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2024

  1. Merge branch 'Lightning-AI:master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 committed Mar 1, 2024
    Configuration menu
    Copy the full SHA
    8311be1 View commit details
    Browse the repository at this point in the history

Commits on Mar 4, 2024

  1. Use device_mesh arg to set flexible HSDP with a Tuple

    @Liyang90
    Liyang90 committed Mar 4, 2024
    Configuration menu
    Copy the full SHA
    d1d719a View commit details
    Browse the repository at this point in the history

Commits on Mar 5, 2024

  1. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    3315893 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'Lightning-AI:master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    4652b74 View commit details
    Browse the repository at this point in the history

  3. minor fix

    @Liyang90
    Liyang90 committed Mar 5, 2024
    Configuration menu
    Copy the full SHA
    4049f60 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2024

  1. add simple docs

    @awaelchli
    awaelchli committed Mar 8, 2024
    Configuration menu
    Copy the full SHA
    9c14afe View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. correct doc string

    @Liyang90
    Liyang90 committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    1f2c3ff View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. set as explicit args in FSDPStrategy

    @Liyang90
    Liyang90 committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    07f7c1b View commit details
    Browse the repository at this point in the history

  2. Merge branch 'Lightning-AI:master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    2ab0423 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    899e032 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. update fsdp tests

    @Liyang90
    Liyang90 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    4259df2 View commit details
    Browse the repository at this point in the history

  2. Type check error

    @Liyang90
    Liyang90 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    dbe22f3 View commit details
    Browse the repository at this point in the history

  3. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    2320a4e View commit details
    Browse the repository at this point in the history

  4. merge

    @Liyang90
    Liyang90 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    b0d4783 View commit details
    Browse the repository at this point in the history

  5. type check

    @Liyang90
    Liyang90 committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    9d7dfbe View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Merge branch 'master' into hybrid_fsdp_stage

    @Liyang90
    Liyang90 committed May 16, 2024
    Configuration menu
    Copy the full SHA
    483f745 View commit details
    Browse the repository at this point in the history

  2. [pre-commit.ci] auto fixes from pre-commit.com hooks 

    for more information, see https://pre-commit.ci
    @pre-commit-ci
    pre-commit-ci[bot] committed May 16, 2024
    Configuration menu
    Copy the full SHA
    ba0b10b View commit details
    Browse the repository at this point in the history