Multiple-choice Question Answering on MMLU-Pro CS
56.8PerformanceRLKV
Evaluation results
| Method | Links | |
|---|---|---|
| RLKVKV Cache Budget Sparsity=0.22025.10 | 56.8 | |
| RLKVKV Cache Budget Sparsity=0.42025.10 | 54.6 | |
| DuoAttentionKV Cache Budget Sparsity=0.22025.10 | 53.7 | |
| KVZipKV Cache Budget Sparsity=0.22025.10 | 51.7 | |
| DuoAttentionKV Cache Budget Sparsity=0.42025.10 | 49.3 | |
| KVZipKV Cache Budget Sparsity=0.42025.10 | 49 | |
| R-KVKV Cache Budget Sparsity=0.22025.10 | 44.6 | |
| RLKVKV Cache Budget Sparsity=0.62025.10 | 43.7 | |
| H2OKV Cache Budget Sparsity=0.22025.10 | 39.5 | |
| R-KVKV Cache Budget Sparsity=0.42025.10 | 39.3 | |
| R-KVKV Cache Budget Sparsity=0.62025.10 | 27.3 | |
| DuoAttentionKV Cache Budget Sparsity=0.62025.10 | 27.3 | |
| H2OKV Cache Budget Sparsity=0.42025.10 | 22.7 | |
| KVZipKV Cache Budget Sparsity=0.62025.10 | 20 | |
| H2OKV Cache Budget Sparsity=0.62025.10 | 11.2 | |
| DuoAttentionKV Cache Budget Sparsity=0.82025.10 | 4.2 | |
| H2OKV Cache Budget Sparsity=0.82025.10 | 2.9 | |
| R-KVKV Cache Budget Sparsity=0.82025.10 | 1.9 | |
| RLKVKV Cache Budget Sparsity=0.82025.10 | 1.7 | |
| KVZipKV Cache Budget Sparsity=0.82025.10 | 1 |