Abstraction and Reasoning on ARC 2 (test)
7.8Pass@2TRM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TRM# params.=7M, Single Loop (No Hier.)=✗, Source=Reported2026.06 | 7.8 | — | |
| TRM# params.=7M, Single Loop (No Hier.)=✗, Source=Our reproduction attempt2026.06 | 6.2 | — | |
| FPRM# params.=7M, Single Loop (No Hier.)=✓, Source=Reported2026.06 | 6.2 | — | |
| HRM# params.=27M, Single Loop (No Hier.)=✗, Source=Reported2026.06 | 5 | — | |
| URM# params.=14M, Single Loop (No Hier.)=✗, Source=Reported2026.06 | — | 16 |