Long Reasoning on MATH500 (pass@k, avg@k)
78Pass@k RateFull
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FullBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=Full2025.05 | 78 | 67.25 | |
| FreeKVBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=FreeKV2025.05 | 78 | 66.75 | |
| FullBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=Full2025.05 | 78 | 71.75 | |
| FreeKVBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=FreeKV2025.05 | 78 | 70 | |
| FreeKVBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=FreeKV2025.05 | 78 | 67.5 | |
| ShadowKVBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=ShadowKV2025.05 | 76 | 60.25 | |
| QuestBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=Quest2025.05 | 76 | 68 | |
| ArkValeBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=ArkVale2025.05 | 76 | 68.25 | |
| QuestBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=Quest2025.05 | 76 | 67.25 | |
| ShadowKVBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=ShadowKV2025.05 | 76 | 65 | |
| RaaSBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=RaaS2025.05 | 74 | 62.5 | |
| InfiniGenBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=InfiniGen2025.05 | 74 | 66.5 | |
| RaaSBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=RaaS2025.05 | 74 | 67 | |
| ShadowKVBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=ShadowKV2025.05 | 74 | 64.75 | |
| InfiniGenBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=InfiniGen2025.05 | 74 | 70 | |
| FullBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=Full2025.05 | 74 | 70.25 | |
| RazorBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=Razor2025.05 | 72 | 60.5 | |
| QuestBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=Quest2025.05 | 72 | 62 | |
| ArkValeBackbone=DeepSeek-R1-Llama-8B, k=8, KV cache method=ArkVale2025.05 | 72 | 62.5 | |
| RazorBackbone=DeepSeek-R1-Qwen-7B, k=8, KV cache method=Razor2025.05 | 72 | 66.75 | |
| ArkValeBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=ArkVale2025.05 | 72 | 66.25 | |
| InfiniGenBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=InfiniGen2025.05 | 72 | 67 | |
| RazorBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=Razor2025.05 | 70 | 59.75 | |
| RaaSBackbone=DeepSeek-R1-Qwen-14B, k=8, KV cache method=RaaS2025.05 | 68 | 64.75 |