Skip to content

IMP-MARL: a Suite of Environments for Large-scale Infrastructure Management Planning via MARL

License

Notifications You must be signed in to change notification settings

moratodpg/imp_marl

Repository files navigation

IMP-MARL: a Suite of Environments for Large-scale Infrastructure Management Planning via MARL

IMP-MARL offers a platform for benchmarking the scalability of cooperative MARL methods in real-world engineering applications.

In IMP-MARL, you can:

Additionally, you will be able to:

  • Retrieve the results of a benchmark campaign, where MARL methods are assessed in terms of scalability.
  • Reproduce our experiments.
  • Add your results to ours through the plot scripts.

This repository has been developed and is maintained by Pascal Leroy & Pablo G. Morato.

Please consider opening an issue or a pull request to help us improve this repository.

Future developments are described in the roadmap.

imp

Requirements

To work with our environments, one only needs to install Numpy.

However, to reproduce our results, more packages are required and installation instructions are provided here.

Tutorials

Sets of environments available

Note: A campaign cost can be activated in any environment.

Available wrappers and examples

All wrappers are available in imp_wrappers.

Run an IMP environment

env = Struct({'n_comp': 3,
               'discount_reward': 0.95,
               'k_comp': 2,
               'env_correlation': False,
               'campaign_cost': False})

obs, done = env.reset(), False
while not done:
    actions = {f"agent_{i}": random.randint(0,2) for i in range(3)}
    obs, rewards, done, insp_outcomes = env.step(actions) 

Citation

If you use IMP-MARL in your work, please consider citing our paper:

IMP-MARL: a Suite of Environments for Large-scale Infrastructure Management Planning via MARL

@inproceedings{
leroy2023impmarl,
title={{IMP}-{MARL}: a Suite of Environments for Large-scale Infrastructure Management Planning via {MARL}},
author={Pascal Leroy and Pablo G. Morato and Jonathan Pisane and Athanasios Kolios and Damien Ernst},
booktitle={Thirty-seventh Conference on Neural Information Processing Systems Datasets and Benchmarks Track},
year={2023},
url={https://openreview.net/forum?id=q3FJk2Nvkk}
}