Last-word prediction on LAMBADA it
17.3Zero-shot AccuracyMGPT-2
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MGPT-2#Params=124M, Patch size=-, zero-shot evaluation=true2026.04 | 17.3 | — | — | |
| MIXAR stage2#Params=477M, Patch size=32×32, zero-shot evaluation=true2026.04 | 11.1 | 52.1 | 56.2 | |
| MIXAR stage2#Params=116M, Patch size=32×32, zero-shot evaluation=true2026.04 | 7.6 | 57.4 | 63.3 | |
| GPT-2#Params=124M, Patch size=-, zero-shot evaluation=true2026.04 | 6.3 | — | — | |
| PIXAR stage2#Params=113M, Patch size=8×8, zero-shot evaluation=true2026.04 | 5.6 | 51.2 | 56.4 | |
| MIXAR stage1#Params=477M, Patch size=32×32, zero-shot evaluation=true2026.04 | 2.9 | 53.7 | 57.6 | |
| MIXAR stage1#Params=116M, Patch size=32×32, zero-shot evaluation=true2026.04 | 1.1 | 45.8 | 50.5 |