Retrieval on RULER 4K context
66.1RULER Average ScoreTriAttention
Evaluation results
| Method | Links | |
|---|---|---|
| TriAttentionModel=Qwen3-8B, KV budget=50%, Context length=4K2026.04 | 66.1 | |
| StreamingLLMModel=Qwen3-8B, KV budget=50%, Context length=4K2026.04 | 61.1 | |
| SnapKVModel=Qwen3-8B, KV budget=50%, Context length=4K2026.04 | 55.6 | |
| PyramidKVModel=Qwen3-8B, KV budget=50%, Context length=4K2026.04 | 40.7 |