Long-context retrieval and reasoning on RULER 1.0 (test)
83.2CWEFullKV
Evaluation Results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FullKVModel=Qwen3-30B-A3B-Instruct-2507, Cache budget=Full2026.05 | 83.2 | 99.33 | 100 | 100 | 100 | 100 | 98.5 | 100 | 100 | 100 | 86 | 64 | 100 | 94.69 | |
| LaProxModel=Qwen3-30B-A3B-Instruct-2507, Cache budget=20%2026.05 | 64.5 | 97 | 100 | 100 | 99 | 100 | 92.75 | 100 | 100 | 100 | 71 | 63 | 99.8 | 91.31 | |
| CriticalKVModel=Qwen3-30B-A3B-Instruct-2507, Cache budget=20%2026.05 | 60.6 | 96 | 100 | 14 | 2 | 100 | 98 | 100 | 100 | 4 | 34 | 48 | 97.2 | 65.67 | |
| AdaKVModel=Qwen3-30B-A3B-Instruct-2507, Cache budget=20%2026.05 | 57.8 | 92 | 8 | 10 | 2 | 16 | 0 | 16 | 0 | 4 | 32 | 46 | 28.4 | 24.02 |