Question Answering on MMLU-Pro Computer Science
63.2AccuracyRLKV
Evaluation results
| Method | Links | |
|---|---|---|
| RLKVKV Cache Budget Sparsity=0.62025.10 | 63.2 | |
| KVZipKV Cache Budget Sparsity=0.42025.10 | 59 | |
| RLKVKV Cache Budget Sparsity=0.42025.10 | 53.2 | |
| KVZipKV Cache Budget Sparsity=0.22025.10 | 51.2 | |
| R-KVKV Cache Budget Sparsity=0.22025.10 | 50.5 | |
| DuoAttentionKV Cache Budget Sparsity=0.22025.10 | 50.2 | |
| R-KVKV Cache Budget Sparsity=0.42025.10 | 48 | |
| KVZipKV Cache Budget Sparsity=0.62025.10 | 47.8 | |
| RLKVKV Cache Budget Sparsity=0.22025.10 | 47.8 | |
| DuoAttentionKV Cache Budget Sparsity=0.42025.10 | 40 | |
| H2OKV Cache Budget Sparsity=0.22025.10 | 39.8 | |
| DuoAttentionKV Cache Budget Sparsity=0.62025.10 | 32.7 | |
| R-KVKV Cache Budget Sparsity=0.62025.10 | 31 | |
| H2OKV Cache Budget Sparsity=0.42025.10 | 21.9 | |
| H2OKV Cache Budget Sparsity=0.62025.10 | 10.7 | |
| RLKVKV Cache Budget Sparsity=0.82025.10 | 10.5 | |
| R-KVKV Cache Budget Sparsity=0.82025.10 | 3.2 | |
| DuoAttentionKV Cache Budget Sparsity=0.82025.10 | 2.9 | |
| KVZipKV Cache Budget Sparsity=0.82025.10 | 0.2 | |
| H2OKV Cache Budget Sparsity=0.82025.10 | 0 |