Multi-Query Associative Recall (MQAR) on MQAR Std-Last v1
93.75AccuracyPythia
Evaluation Results
| Method | Links | |
|---|---|---|
| PythiaScale=133m2024.10 | 93.75 | |
| Mamba w/ Global SelectionScale=133m, Global Selection=true2024.10 | 41.97 | |
| Mamba w/ 2xState SizeScale=130m, State Size=2x2024.10 | 40.22 | |
| Mamba w/ 4xState SizeScale=134m, State Size=4x2024.10 | 35.89 | |
| MambaScale=129m2024.10 | 15.44 |