Multi-Query Associative Recall (MQAR) on MQAR K2V2 v1
99.99AccuracyPythia
Evaluation Results
| Method | Links | |
|---|---|---|
| PythiaScale=133m2024.10 | 99.99 | |
| MambaScale=129m2024.10 | 99.98 | |
| Mamba w/ 2xState SizeScale=130m, State Size=2x2024.10 | 99.84 | |
| Mamba w/ 4xState SizeScale=134m, State Size=4x2024.10 | 99.84 | |
| Mamba w/ Global SelectionScale=133m, Global Selection=true2024.10 | 99.06 | |
| RWKVScale=153m2024.10 | 85.99 | |
| HyenaScale=153m2024.10 | 77.62 |