Reinforcement Learning on Atari 100K (test)
2.791Mean ScoreDIAMOND
Evaluation results
| Method | Links | |||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DIAMOND2025.05 | 2.791 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 11 | — | 2.15 | 0.087 | |
| JEDI2025.05 | 2.425 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 9 | — | 1.64 | 0.219 | |
| STORM2025.05 | 2.206 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 9 | — | 1.486 | 0.177 | |
| DreamerV32025.05 | 2.078 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 9 | — | 1.303 | 0.176 | |
| IRIS2025.05 | 1.93 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 9 | — | 1.461 | 0.172 | |
| EASimulusbase_model=Simulus2026.01 | 1.818 | 740 | 148.2 | 2,112.7 | 1,590.3 | 524.9 | 14,348.1 | 87.4 | 236.5 | 3,446.3 | 79,274.4 | 5,081.9 | 32.4 | 579.5 | 5,300 | 7,273.4 | 612.4 | 7,569.6 | 9,065 | 19,456.2 | 1,430.5 | 20 | 100 | 3,649.2 | 20,748.5 | 1,405.9 | 5,742.4 | 12 | 0.773 | 1.004 | 0.394 | |
| TWM2025.05 | 1.746 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 8 | — | 1.051 | 0.185 | |
| Simulus2026.01 | 1.609 | 691.8 | 104.7 | 1,528.8 | 1,477.3 | 283.1 | 10,142.3 | 91.2 | 153.4 | 4,593.6 | 77,456.3 | 5,045.9 | 31.2 | 264.2 | 4,414.2 | 6,626.9 | 677.3 | 7,858 | 7,385.7 | 20,463.1 | 1,331.9 | 19.1 | 58.7 | 2,234 | 26,325 | 1,602.7 | 3,609.9 | 12 | 0.737 | 0.913 | 0.424 | |
| DIAMOND2026.01 | 1.459 | 744.1 | 225.8 | 1,526.4 | 3,698.5 | 19.7 | 4,702 | 86.9 | 132.5 | 1,369.8 | 99,167.8 | 288.1 | 33.3 | 274.1 | 5,897.9 | 5,621.8 | 427.4 | 5,382.2 | 8,610.1 | 18,713.6 | 1,958.2 | 20.4 | 114.3 | 4,499.3 | 20,673.2 | 551.2 | 3,856.3 | 11 | 0.373 | 0.641 | 0.48 | |
| EADreambase_model=DreamerV32026.01 | 1.29 | 776.4 | 144.2 | 883.4 | 1,096.9 | 742.6 | 13,372 | 85.4 | 71.8 | 904 | 89,038.6 | 152.2 | 0 | 692.6 | 4,415.8 | 8,801.8 | 337.2 | 3,875.6 | 8,729.6 | 23,434.6 | 1,580.7 | 20.1 | -472.5 | 1,664.4 | 12,518.6 | 557.9 | 28,408.2 | 12 | 0.651 | 0.593 | 0.474 | |
| REM2026.01 | 1.222 | 607.2 | 95.3 | 1,764.2 | 1,637.5 | 19.2 | 11,826 | 87.5 | 90.7 | 2,561.2 | 76,547.6 | 5,738.6 | 32.3 | 240.5 | 5,452.4 | 6,484.8 | 391.2 | 467.6 | 4,017.7 | 25,172.2 | 962.5 | 18 | 99.6 | 743 | 14,060.2 | 1,036.7 | 3,757.6 | 12 | 0.28 | 0.673 | 0.482 | |
| HarmonyDream2026.01 | 1.2 | 1,179.3 | 166.3 | 701.7 | 1,260.2 | 627.1 | 11,563.3 | 86 | 34.9 | 627 | 54,687.3 | 267 | 0 | 1,937.9 | 9,564.7 | 9,865.3 | 327.8 | 5,237.3 | 7,784 | 22,131.7 | 2,663.3 | 20 | -198.6 | 1,863.3 | 12,478.3 | 540.7 | 10,007.1 | 9 | 0.634 | 0.561 | 0.473 | |
| DreamerV3implementation=PyTorch2026.01 | 1.15 | 1,024.9 | 130.8 | 723.6 | 1,024.2 | 1,018.9 | 11,246.7 | 84.8 | 26.9 | 709.7 | 81,414.7 | 226.5 | 9.5 | 251.7 | 4,074.9 | 4,650.9 | 331.8 | 3,851.7 | 7,796.6 | 18,917.1 | 1,813.3 | 17.1 | 47.4 | 873.2 | 14,478.3 | 479.1 | 20,183.2 | 10 | 0.575 | 0.521 | 0.501 | |
| Human2026.01 | 1 | 7,127.7 | 1,719.5 | 742 | 8,503.3 | 753.1 | 37,187.5 | 12.1 | 30.5 | 7,387.8 | 35,829.4 | 1,971 | 29.6 | 4,334.7 | 2,412.5 | 30,826.4 | 302.8 | 3,035 | 2,665.5 | 22,736.3 | 6,951.6 | 14.6 | 69,571.3 | 13,455 | 7,845 | 42,054.7 | 11,693.2 | — | 1 | 1 | 0 | |
| JEDI2025.05 | 0.297 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2 | — | 0.156 | 0.74 | |
| STORM2025.05 | 0.238 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0 | — | 0.184 | 0.766 | |
| DreamerV32025.05 | 0.19 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0 | — | 0.122 | 0.823 | |
| TWM2025.05 | 0.166 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0 | — | 0.112 | 0.84 | |
| IRIS2025.05 | 0.162 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1 | — | 0.072 | 0.852 | |
| DIAMOND2025.05 | 0.127 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0 | — | 0.091 | 0.873 | |
| Random2026.01 | 0 | 227.8 | 5.8 | 222.4 | 210 | 14.2 | 2,360 | 0.1 | 1.7 | 811 | 10,780.5 | 152.1 | 0 | 65.2 | 257.6 | 1,027 | 29 | 52 | 1,598 | 258.5 | 307.3 | -20.7 | 24.9 | 163.9 | 11.5 | 68.4 | 533.4 | 0 | 0 | 0 | 1 |