Long Reasoning on GPQA
86Pass@kFreeKV
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FreeKVBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=FreeKV2025.05 | 86 | 41.25 | |
| ArkValeBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=ArkVale2025.05 | 86 | 53.75 | |
| ShadowKVBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=ShadowKV2025.05 | 86 | 51.75 | |
| FreeKVBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=FreeKV2025.05 | 86 | 56 | |
| FullBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=Full2025.05 | 82 | 39.75 | |
| FullBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=Full2025.05 | 82 | 53.25 | |
| RaaSBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=RaaS2025.05 | 80 | 44.25 | |
| QuestBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=Quest2025.05 | 80 | 51.25 | |
| ShadowKVBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=ShadowKV2025.05 | 78 | 36.25 | |
| QuestBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=Quest2025.05 | 76 | 37.25 | |
| FreeKVBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=FreeKV2025.05 | 74 | 39.5 | |
| ArkValeBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=ArkVale2025.05 | 72 | 39.75 | |
| FullBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=Full2025.05 | 72 | 35.75 | |
| QuestBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=Quest2025.05 | 72 | 38.75 | |
| ArkValeBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=ArkVale2025.05 | 72 | 34.25 | |
| ShadowKVBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=ShadowKV2025.05 | 70 | 33.5 | |
| RazorBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=Razor2025.05 | 68 | 38.5 | |
| RaaSBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=RaaS2025.05 | 64 | 33.5 | |
| RazorBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=Razor2025.05 | 60 | 34.25 | |
| RazorBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=Razor2025.05 | 60 | 32.5 | |
| RaaSBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=RaaS2025.05 | 58 | 33.25 | |
| InfiniGenBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=InfiniGen2025.05 | 58 | 35.5 | |
| InfiniGenBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=InfiniGen2025.05 | 58 | 38 | |
| InfiniGenBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=InfiniGen2025.05 | 46 | 27.5 |