Multi-Query Associative Recall (MQAR) on MQAR K2V2-Robustness v1
99.99AccuracyPythia
Evaluation Results
| Method | Links | |
|---|---|---|
| PythiaScale=133m2024.10 | 99.99 | |
| Mamba w/ Global SelectionScale=133m, Global Selection=true2024.10 | 81.46 | |
| Mamba w/ 2xState SizeScale=130m, State Size=2x2024.10 | 78.9 | |
| RWKVScale=153m2024.10 | 72.62 | |
| MambaScale=129m2024.10 | 66.01 | |
| HyenaScale=153m2024.10 | 65.92 | |
| Mamba w/ 4xState SizeScale=134m, State Size=4x2024.10 | 57.11 |