Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement Gymnasium-compliant PPO script #320

Merged
merged 43 commits into from Dec 13, 2022
Merged

Implement Gymnasium-compliant PPO script #320

merged 43 commits into from Dec 13, 2022

Commits on Nov 15, 2022

  1. Add Gymnasium and dependencies

    @dtch1997
    dtch1997 committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    be6da79 View commit details
    Browse the repository at this point in the history

  2. Implement Gymnasium-compliant PPO script

    @dtch1997
    dtch1997 committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    d098870 View commit details
    Browse the repository at this point in the history

  3. Ensure pre-commit passes

    @dtch1997
    dtch1997 committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    aa9ac0c View commit details
    Browse the repository at this point in the history

  4. Fix CI, add a gymnasium_support folder

    @vwxyzjn
    vwxyzjn committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    cb08637 View commit details
    Browse the repository at this point in the history

  5. update lock files

    @vwxyzjn
    vwxyzjn committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    5818d7d View commit details
    Browse the repository at this point in the history

  6. add dependencies

    @vwxyzjn
    vwxyzjn committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    51a7128 View commit details
    Browse the repository at this point in the history

  7. update requirements.txt; fix pre-commit

    @vwxyzjn
    vwxyzjn committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    363b48e View commit details
    Browse the repository at this point in the history

  8. update poetry files

    @vwxyzjn
    vwxyzjn committed Nov 15, 2022
    Configuration menu
    Copy the full SHA
    e3174ca View commit details
    Browse the repository at this point in the history

Commits on Nov 21, 2022

  1. Support dm control action spaces

    @vwxyzjn
    vwxyzjn committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    8da5f7b View commit details
    Browse the repository at this point in the history

  2. add dm_control support

    @vwxyzjn
    vwxyzjn committed Nov 21, 2022
    Configuration menu
    Copy the full SHA
    0544fcb View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2022

  1. Enable num_envs>1

    @dtch1997
    dtch1997 committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    d30f3cf View commit details
    Browse the repository at this point in the history

  2. Enable auto-install of torch based on CUDA version

    @dtch1997
    dtch1997 committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    99f7789 View commit details
    Browse the repository at this point in the history

  3. Fix pre-commit

    @dtch1997
    dtch1997 committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    cbd83f6 View commit details
    Browse the repository at this point in the history

Commits on Dec 10, 2022

  1. bump torch version

    @vwxyzjn
    vwxyzjn committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    8cf18e3 View commit details
    Browse the repository at this point in the history

  2. bump wandb version

    @vwxyzjn
    vwxyzjn committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    fe81b99 View commit details
    Browse the repository at this point in the history

  3. change key for mujoco_py installation

    @vwxyzjn
    vwxyzjn committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    dd80937 View commit details
    Browse the repository at this point in the history

  4. update CI

    @vwxyzjn
    vwxyzjn committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    c46f700 View commit details
    Browse the repository at this point in the history

  5. update docs

    @vwxyzjn
    vwxyzjn committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    0d3a5e1 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'gymnasium_ppo' of https://github.com/vwxyzjn/cleanrl in… 

    …to gymnasium_ppo
    @vwxyzjn
    vwxyzjn committed Dec 10, 2022
    Configuration menu
    Copy the full SHA
    fa73a60 View commit details
    Browse the repository at this point in the history

Commits on Dec 11, 2022

  1. downgrade torch

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    0381d7a View commit details
    Browse the repository at this point in the history

  2. update docs

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    6582fab View commit details
    Browse the repository at this point in the history

  3. update teset cases

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    b3f19fd View commit details
    Browse the repository at this point in the history

  4. set default env = HalfCheetah-v4

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    1e904a3 View commit details
    Browse the repository at this point in the history

  5. directly replace ppo_continuous_action.py

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    3cd9917 View commit details
    Browse the repository at this point in the history

  6. deprecate pybullet dependency in ppo

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    08f9744 View commit details
    Browse the repository at this point in the history

  7. remove pybullet test case

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    b81d207 View commit details
    Browse the repository at this point in the history

  8. support video recording to wandb

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    de3f410 View commit details
    Browse the repository at this point in the history

  9. update docs

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    1b01a4f View commit details
    Browse the repository at this point in the history

  10. update depdency for test cases

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    73c0caf View commit details
    Browse the repository at this point in the history

  11. update test cases and add dm_control tests

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    3df239a View commit details
    Browse the repository at this point in the history

  12. update docs

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    8a9a467 View commit details
    Browse the repository at this point in the history

  13. update mkdocs base

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    b56fe05 View commit details
    Browse the repository at this point in the history

  14. revert doc changes

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    7660199 View commit details
    Browse the repository at this point in the history

  15. fix dm_control test cases

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    8fd5657 View commit details
    Browse the repository at this point in the history

  16. quick docs

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    a140a3e View commit details
    Browse the repository at this point in the history

  17. fix tests on CI

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    708cfad View commit details
    Browse the repository at this point in the history

  18. fix test case

    @vwxyzjn
    vwxyzjn committed Dec 11, 2022
    Configuration menu
    Copy the full SHA
    6a41003 View commit details
    Browse the repository at this point in the history

Commits on Dec 12, 2022

  1. fix CI

    @vwxyzjn
    vwxyzjn committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    3efbc24 View commit details
    Browse the repository at this point in the history

  2. Fix CI

    @vwxyzjn
    vwxyzjn committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    0e8df6f View commit details
    Browse the repository at this point in the history

  3. update mujoco dependency

    @vwxyzjn
    vwxyzjn committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    19d08d5 View commit details
    Browse the repository at this point in the history

  4. Fix CI

    @vwxyzjn
    vwxyzjn committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    55f2209 View commit details
    Browse the repository at this point in the history

  5. fix CI

    @vwxyzjn
    vwxyzjn committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    7ef728c View commit details
    Browse the repository at this point in the history

  6. remote unused seed

    @vwxyzjn
    vwxyzjn committed Dec 12, 2022
    Configuration menu
    Copy the full SHA
    d2b0a79 View commit details
    Browse the repository at this point in the history