Key Information Retrieval on Needle-in-a-Haystack 32K context
98.2AccuracyMEAP
Evaluation results
| Method | Links | |
|---|---|---|
| MEAPTraining Tokens=200B2025.02 | 98.2 | |
| Full ModelKV Cache Budget=Full2026.03 | 93.85 | |
| SemantiCacheKV Cache Budget=40962026.03 | 91.15 | |
| D2OKV Cache Budget=40962026.03 | 90.29 | |
| SemantiCacheKV Cache Budget=10242026.03 | 87.23 | |
| NTPTraining Tokens=200B2025.02 | 87.1 | |
| D2OKV Cache Budget=10242026.03 | 86.82 | |
| MEAPTraining Tokens=60B2025.02 | 85.8 | |
| SnapKVKV Cache Budget=40962026.03 | 80.29 | |
| MEAPTraining Tokens=40B2025.02 | 80.2 | |
| CaMKV Cache Budget=10242026.03 | 77.33 | |
| CaMKV Cache Budget=40962026.03 | 77.2 | |
| SnapKVKV Cache Budget=10242026.03 | 75.84 | |
| H2OKV Cache Budget=40962026.03 | 71.88 | |
| H2OKV Cache Budget=10242026.03 | 68.21 | |
| NTPTraining Tokens=40B2025.02 | 65.9 | |
| NTPTraining Tokens=60B2025.02 | 52.8 | |
| StreamingLLMKV Cache Budget=40962026.03 | 50.88 | |
| StreamingLLMKV Cache Budget=10242026.03 | 46.81 |