# Multi-Agent Reinforcement Learning on SMAC terran\_10v10 v2 (test)

Source: [Multi-Agent Reinforcement Learning on SMAC terran\_10v10 v2 (test)](<https://www.sota2.com/research/sota/multi-agent-reinforcement-learning-on-smac-terran_10v10-v2-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-07T08:51:22.470Z

Evaluation of Multi-Agent Reinforcement Learning performance on the specific SMAC scenario 'terran\_10v10' using version 2 of the environment, tested on the test split. Metrics include Win Rate (WR) and Area Under the Curve (AUC).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Multi-Agent Reinforcement Learning |
| Dataset (including any stated split) | SMAC terran\_10v10 v2 (test) |
| Metric | AUC |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUC](<https://www.sota2.com/research/sota/multi-agent-reinforcement-learning-on-smac-terran_10v10-v2-test.md?metric=AUC>): Higher is better; unit: PERCENT.

- [Win Rate](<https://www.sota2.com/research/sota/multi-agent-reinforcement-learning-on-smac-terran_10v10-v2-test.md?metric=Win%20Rate>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AUC | Result date | Report paper |
| --- | --- | --- | --- |
| MUTE | 36.4 | Not recorded | 6a4c881585dba69fef8b2806 |
| HIBCG | 24.6 | Not recorded | 6a0bee9ddbc836b87d82c492 |
| ExpoComm | 23.7 | Not recorded | 6a0bee9ddbc836b87d82c492 |
| QMIX | 23.1 | Not recorded | 6a0bee9ddbc836b87d82c492 |
| BVME | 21.7 | Not recorded | 6a0bee9ddbc836b87d82c492 |
| CommFormer | 21.6 | Not recorded | 6a0bee9ddbc836b87d82c492 |
| MASIA | 20.9 | Not recorded | 6a4c881585dba69fef8b2806 |
| MAGI | 20.8 | Not recorded | 6a0bee9ddbc836b87d82c492 |
| HIB-flat | 20.8 | Not recorded | 6a0bee9ddbc836b87d82c492 |
| GACG | 19.6 | Not recorded | 6a0bee9ddbc836b87d82c492 |
| AIB-only | 19.3 | Not recorded | 6a0bee9ddbc836b87d82c492 |
| SMS | 18.5 | Not recorded | 6a4c881585dba69fef8b2806 |
| MAIC | 18.1 | Not recorded | 6a4c881585dba69fef8b2806 |
| TarMAC | 7.9 | Not recorded | 6a4c881585dba69fef8b2806 |
| IC3Net | 0.5 | Not recorded | 6a4c881585dba69fef8b2806 |

### MUTE

AUC: 36.4. Result ID: 6a4cbdf060b88bb339c8e710.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881585dba69fef8b2806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881585dba69fef8b2806.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HIBCG

AUC: 24.6. Result ID: 6a0c36bafbc373592c02db90.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

Recorded evaluation configuration: {"config":"AIB+XIB+GP"}. This record does not assert independent reproduction.

### ExpoComm

AUC: 23.7. Result ID: 6a0c36bafbc373592c02db8b.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa772e1e209131cea719f9.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### QMIX

AUC: 23.1. Result ID: 6a0c36bafbc373592c02db88.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64671e209131cea046e9.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BVME

AUC: 21.7. Result ID: 6a0c36bafbc373592c02db8d.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### CommFormer

AUC: 21.6. Result ID: 6a0c36bafbc373592c02db8a.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73351e209131cea5b287.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MASIA

AUC: 20.9. Result ID: 6a4cbdf060b88bb339c8e70e.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881585dba69fef8b2806.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MAGI

AUC: 20.8. Result ID: 6a0c36bafbc373592c02db89.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HIB-flat

AUC: 20.8. Result ID: 6a0c36bafbc373592c02db8f.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

Recorded evaluation configuration: {"config":"AIB+XIB, flat"}. This record does not assert independent reproduction.

### GACG

AUC: 19.6. Result ID: 6a0c36bafbc373592c02db8c.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73271e209131cea5ab8a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### AIB-only

AUC: 19.3. Result ID: 6a0c36bafbc373592c02db8e.

[Reporting paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0bee9ddbc836b87d82c492.md>)

Recorded evaluation configuration: {"config":"structural IB"}. This record does not assert independent reproduction.

### SMS

AUC: 18.5. Result ID: 6a4cbdf060b88bb339c8e70f.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881585dba69fef8b2806.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MAIC

AUC: 18.1. Result ID: 6a4cbdf060b88bb339c8e70d.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881585dba69fef8b2806.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TarMAC

AUC: 7.9. Result ID: 6a4cbdf060b88bb339c8e70c.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881585dba69fef8b2806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67171e209131cea140be.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### IC3Net

AUC: 0.5. Result ID: 6a4cbdf060b88bb339c8e70b.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881585dba69fef8b2806.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa653c1e209131cea09416.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
