Long Context Retrieval on NIAH-Multi
100AccuracyKimi-K2
Evaluation Results
| Method | Links | |
|---|---|---|
| Kimi-K2Length=64K, #Activated Params=32B, #Total Params=1043B2026.01 | 100 | |
| MiMo-V2-FlashLength=64K, #Activated Params=15B, #Total Params=309B2026.01 | 99.9 | |
| Kimi-K2Length=32K, #Activated Params=32B, #Total Params=1043B2026.01 | 99.8 | |
| DeepSeek-V3.1Length=32K, #Activated Params=37B, #Total Params=671B2026.01 | 99.7 | |
| Kimi-K2Length=128K, #Activated Params=32B, #Total Params=1043B2026.01 | 99.5 | |
| MiMo-V2-FlashLength=32K, #Activated Params=15B, #Total Params=309B2026.01 | 99.3 | |
| MiMo-V2-FlashLength=128K, #Activated Params=15B, #Total Params=309B2026.01 | 98.6 | |
| DeepSeek-V3.1Length=64K, #Activated Params=37B, #Total Params=671B2026.01 | 98.6 | |
| DeepSeek-V3.1Length=128K, #Activated Params=37B, #Total Params=671B2026.01 | 97.2 | |
| MiMo-V2-FlashLength=256K, #Activated Params=15B, #Total Params=309B2026.01 | 96.7 | |
| DeepSeek-V3.2Length=128K, #Activated Params=37B, #Total Params=671B2026.01 | 94.3 | |
| DeepSeek-V3.2Length=64K, #Activated Params=37B, #Total Params=671B2026.01 | 85.9 | |
| DeepSeek-V3.2Length=32K, #Activated Params=37B, #Total Params=671B2026.01 | 85.6 |