Multiple-choice Question Answering on MMLU-Pro Law
30.8AccuracyKVZip
Evaluation Results
| Method | Links | |
|---|---|---|
| KVZipKV Cache Budget Sparsity=0.42025.10 | 30.8 | |
| RLKVKV Cache Budget Sparsity=0.62025.10 | 27.6 | |
| RLKVKV Cache Budget Sparsity=0.42025.10 | 27.2 | |
| RLKVKV Cache Budget Sparsity=0.22025.10 | 27 | |
| KVZipKV Cache Budget Sparsity=0.22025.10 | 26.8 | |
| R-KVKV Cache Budget Sparsity=0.22025.10 | 26.2 | |
| DuoAttentionKV Cache Budget Sparsity=0.22025.10 | 26.2 | |
| H2OKV Cache Budget Sparsity=0.22025.10 | 25.8 | |
| KVZipKV Cache Budget Sparsity=0.62025.10 | 23.4 | |
| R-KVKV Cache Budget Sparsity=0.42025.10 | 22 | |
| H2OKV Cache Budget Sparsity=0.42025.10 | 19 | |
| DuoAttentionKV Cache Budget Sparsity=0.42025.10 | 17.8 | |
| DuoAttentionKV Cache Budget Sparsity=0.42025.10 | 15.6 | |
| H2OKV Cache Budget Sparsity=0.22025.10 | 13.8 | |
| DuoAttentionKV Cache Budget Sparsity=0.62025.10 | 13.8 | |
| RLKVKV Cache Budget Sparsity=0.42025.10 | 12.6 | |
| R-KVKV Cache Budget Sparsity=0.22025.10 | 12 | |
| RLKVKV Cache Budget Sparsity=0.22025.10 | 11.8 | |
| H2OKV Cache Budget Sparsity=0.42025.10 | 11.4 | |
| KVZipKV Cache Budget Sparsity=0.22025.10 | 10.8 | |
| DuoAttentionKV Cache Budget Sparsity=0.62025.10 | 10.6 | |
| DuoAttentionKV Cache Budget Sparsity=0.22025.10 | 9.8 | |
| RLKVKV Cache Budget Sparsity=0.62025.10 | 9.8 | |
| R-KVKV Cache Budget Sparsity=0.62025.10 | 9.6 | |
| KVZipKV Cache Budget Sparsity=0.42025.10 | 9 | |
| H2OKV Cache Budget Sparsity=0.62025.10 | 9 | |
| R-KVKV Cache Budget Sparsity=0.42025.10 | 7.6 | |
| RLKVKV Cache Budget Sparsity=0.82025.10 | 7.4 | |
| R-KVKV Cache Budget Sparsity=0.62025.10 | 3.8 | |
| KVZipKV Cache Budget Sparsity=0.62025.10 | 3.8 | |
| H2OKV Cache Budget Sparsity=0.62025.10 | 3 | |
| DuoAttentionKV Cache Budget Sparsity=0.82025.10 | 2.4 | |
| RLKVKV Cache Budget Sparsity=0.82025.10 | 2.4 | |
| DuoAttentionKV Cache Budget Sparsity=0.82025.10 | 1.8 | |
| R-KVKV Cache Budget Sparsity=0.82025.10 | 0.8 | |
| KVZipKV Cache Budget Sparsity=0.82025.10 | 0.4 | |
| R-KVKV Cache Budget Sparsity=0.82025.10 | 0.2 | |
| KVZipKV Cache Budget Sparsity=0.82025.10 | 0.2 | |
| H2OKV Cache Budget Sparsity=0.82025.10 | 0 | |
| H2OKV Cache Budget Sparsity=0.82025.10 | 0 |