# BenchMARL: Benchmarking Multi-Agent Reinforcement Learning

Source: [BenchMARL: Benchmarking Multi-Agent Reinforcement Learning](<https://www.sota2.com/research/paper/68fa75d01e209131cea69f9a>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T03:41:42.944Z

Authors: Matteo Bettini, Amanda Prorok, Vincent Moens

Published: 2023-12-03T18:15:58.000Z

## Abstract

The field of Multi-Agent Reinforcement Learning (MARL) is currently facing a reproducibility crisis. While solutions for standardized reporting have been proposed to address the issue, we still lack a benchmarking tool that enables standardization and reproducibility, while leveraging cutting-edge Reinforcement Learning (RL) implementations. In this paper, we introduce BenchMARL, the first MARL training library created to enable standardized benchmarking across different algorithms, models, and environments. BenchMARL uses TorchRL as its backend, granting it high performance and maintained state-of-the-art implementations while addressing the broad community of MARL PyTorch users. Its design enables systematic configuration and reporting, thus allowing users to create and run complex benchmarks from simple one-line inputs. BenchMARL is open-sourced on GitHub: https://github.com/facebookresearch/BenchMARL

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Multi-agent P2P Energy Trading Optimization on IEEE 141-bus (test)](<https://www.sota2.com/research/sota/multi-agent-p2p-energy-trading-optimization-on-ieee-141-bus-test.md>): Multi-agent P2P energy trading optimization; IEEE 141-bus (test); Mean Operational Cost (CNY): 6586.45.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2312.01472>)

[PDF](<https://arxiv.org/pdf/2312.01472.pdf>)
