Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add gym-derk to environments #2044

Merged
merged 2 commits into from Sep 25, 2020
Merged

Add gym-derk to environments #2044

merged 2 commits into from Sep 25, 2020

Conversation

FredrikNoren
Copy link
Contributor

@FredrikNoren FredrikNoren commented Sep 5, 2020

Hi,

I'm the author of Derk's Gym, which I implemented to be as compatible as possible with OpenAI gym. It's a multi-agent environment though, and as far as I can tell there's no clear consensus on how to handle that. I tried to model the API after the multiagent-particles-env.

Would also love to get feedback on the environment itself!

@pzhokhov pzhokhov merged commit 0424d59 into openai:master Sep 25, 2020
@pzhokhov
Copy link
Collaborator

Looks super fun! Yeah, you are right, Gym API is mostly tuned for single player; and I don't think there is a perfect consensus on how to handle the multi-agent environments... One easy hack for multiplayer environments is vectorization - assuming observation and action spaces are the same, all you have to do is dedicate different indices of environments to different agents.
This repo: https://github.com/openai/multi-agent-emergence-environments takes a somewhat different approach, and joins all observations spaces and all action spaces in a tuple. There is a lot of surrounding code to deal with it too.

@FredrikNoren
Copy link
Contributor Author

@pzhokhov Thank you! Yeah for performance reasons I ended up handling observations and actions as single numpy arrays (I guess that's what you mean with vectorization).

zlig pushed a commit to zlig/gym that referenced this pull request Sep 6, 2021
Co-authored-by: pzhokhov <peterz@openai.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants