Functionally equivalent reasoning on Minecraft
50BridgeEq Success@0→10Echo
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| EchoModel category=Few-shot Variants, k-shot=8, Component configuration=Full model2026.04 | 50 | 80 | 47.5 | 80 | 45 | 75 | |
| MrSteveModel category=Memory-enhanced Models, Component configuration=Full model2026.04 | 47.5 | 77.5 | 45 | 77.5 | 42.5 | 72.5 | |
| JARVIS-1Model category=Memory-enhanced Models, Component configuration=Full model2026.04 | 47.5 | 77.5 | 45 | 75 | 40 | 70 | |
| MP5Model category=Memory-enhanced Models, Component configuration=Full model2026.04 | 45 | 75 | 42.5 | 70 | 37.5 | 65 | |
| EchoModel category=Few-shot Variants, k-shot=4, Component configuration=Full model2026.04 | 40 | 72.5 | 35 | 62.5 | 40 | 65 | |
| EchoModel category=Few-shot Variants, k-shot=1, Component configuration=Full model2026.04 | 37.5 | 60 | 32.5 | 65 | 27.5 | 50 | |
| PatrollerModel category=Memory-enhanced Models, Component configuration=Component disabled2026.04 | 35 | 60 | 35 | 55 | 30 | 50 | |
| SelfCheckModel category=Memory-enhanced Models, Component configuration=Component disabled2026.04 | 35 | 60 | 32.5 | 57.5 | 27.5 | 50 | |
| EchoModel category=Few-shot Variants, k-shot=2, Component configuration=Full model2026.04 | 35 | 65 | 37.5 | 62.5 | 40 | 65 | |
| VoyagerModel category=Memory-enhanced Models, Component configuration=Full model2026.04 | 17.5 | 40 | 15 | 35 | 15 | 32.5 | |
| Self VerificationModel category=Memory-enhanced Models, Component configuration=Component disabled2026.04 | 12.5 | 27.5 | 10 | 25 | 7.5 | 20 |