Benchmarks

Task NameDataset NameSOTA ResultTrendResults

Adversarial Attack

Google Research Football 3 vs 1

5.43Reward

Adversarial Attack

Google Research Football counterattack

5.21Reward

Multi-Agent Reinforcement Learning

Google Research Football CA_hard (test)

62.6Win Rate

Multi-Agent Reinforcement Learning

Google Research Football CA_easy (test)

72.1Win Rate

Multi-Agent Reinforcement Learning

Google Research Football 3_vs_1WK (test)

94.5Win Rate

Multi-agent reinforcement learning

Google Research Football (GRF)

97Win Rate: Pass and Shoot

Multi-Agent Reinforcement Learning

Google Research Football (GRF) Corner (test)

36Mean Success Rate

Multi-Agent Reinforcement Learning

Google Research Football (GRF) CA-Hard (test)

0.83Mean Success Rate

Multi-Agent Reinforcement Learning

Google Research Football (GRF) RPS (test)

75Mean Success Rate

Multi-agent reinforcement learning

Google Research Football Academy scenarios

100Pass & Shoot Success Rate

Multi-agent coordination

Google Research Football (GRF) 3-vs-1 with keeper

2.5Goal Rate

Multi-Agent Reinforcement Learning

Google Research Football academy_pass_and_shoot_with_keeper

430.1Parameters (K)

Multi-Agent Reinforcement Learning

Google Research Football academy_counterattack_easy

430.36Parameters (K)

Multi-Agent Reinforcement Learning

Google Research Football academy_3_vs_1_with_keeper

430.36Params (K)

Multi-Agent Reinforcement Learning

Google Research Football 3vs1

100Goal Rate

Transfer Learning in MARL

Google Research Football 3vs1 with keeper to 5vs5 Full game

0.4Environment Steps

Transfer Learning in MARL

Google Research Football 5vs5 to 11vs11

0.77Environment Steps