Multiple-choice Question Answering on MMLU-Pro Phys.
70.4Accuracy (%)KVZip
Evaluation Results
| Method | Links | |
|---|---|---|
| KVZipKV Cache Budget Sparsity=0.42025.10 | 70.4 | |
| RLKVKV Cache Budget Sparsity=0.42025.10 | 69.8 | |
| RLKVKV Cache Budget Sparsity=0.22025.10 | 66.8 | |
| DuoAttentionKV Cache Budget Sparsity=0.22025.10 | 66.6 | |
| KVZipKV Cache Budget Sparsity=0.22025.10 | 66.6 | |
| RLKVKV Cache Budget Sparsity=0.62025.10 | 64.2 | |
| DuoAttentionKV Cache Budget Sparsity=0.42025.10 | 62.8 | |
| R-KVKV Cache Budget Sparsity=0.22025.10 | 61.6 | |
| RLKVKV Cache Budget Sparsity=0.22025.10 | 56.8 | |
| RLKVKV Cache Budget Sparsity=0.42025.10 | 53.8 | |
| KVZipKV Cache Budget Sparsity=0.62025.10 | 53.4 | |
| DuoAttentionKV Cache Budget Sparsity=0.22025.10 | 52.4 | |
| KVZipKV Cache Budget Sparsity=0.22025.10 | 51 | |
| R-KVKV Cache Budget Sparsity=0.42025.10 | 50.4 | |
| R-KVKV Cache Budget Sparsity=0.22025.10 | 49.2 | |
| DuoAttentionKV Cache Budget Sparsity=0.42025.10 | 47.6 | |
| KVZipKV Cache Budget Sparsity=0.42025.10 | 44.6 | |
| R-KVKV Cache Budget Sparsity=0.42025.10 | 38.2 | |
| RLKVKV Cache Budget Sparsity=0.62025.10 | 37 | |
| DuoAttentionKV Cache Budget Sparsity=0.62025.10 | 34.6 | |
| DuoAttentionKV Cache Budget Sparsity=0.62025.10 | 26 | |
| H2OKV Cache Budget Sparsity=0.22025.10 | 25.6 | |
| H2OKV Cache Budget Sparsity=0.22025.10 | 24.8 | |
| R-KVKV Cache Budget Sparsity=0.62025.10 | 24.2 | |
| R-KVKV Cache Budget Sparsity=0.62025.10 | 23.4 | |
| KVZipKV Cache Budget Sparsity=0.62025.10 | 19.4 | |
| H2OKV Cache Budget Sparsity=0.42025.10 | 13.2 | |
| H2OKV Cache Budget Sparsity=0.42025.10 | 11.4 | |
| RLKVKV Cache Budget Sparsity=0.82025.10 | 8.4 | |
| H2OKV Cache Budget Sparsity=0.62025.10 | 5.6 | |
| H2OKV Cache Budget Sparsity=0.62025.10 | 4.6 | |
| DuoAttentionKV Cache Budget Sparsity=0.82025.10 | 3 | |
| R-KVKV Cache Budget Sparsity=0.82025.10 | 2.2 | |
| DuoAttentionKV Cache Budget Sparsity=0.82025.10 | 2.2 | |
| R-KVKV Cache Budget Sparsity=0.82025.10 | 1.6 | |
| H2OKV Cache Budget Sparsity=0.82025.10 | 1.4 | |
| RLKVKV Cache Budget Sparsity=0.82025.10 | 1.2 | |
| KVZipKV Cache Budget Sparsity=0.82025.10 | 0.4 | |
| H2OKV Cache Budget Sparsity=0.82025.10 | 0.2 | |
| KVZipKV Cache Budget Sparsity=0.82025.10 | 0 |