List your company
ResearchFormerly WizWand

Multiple-choice Question Answering on MMLU-Pro Law

30.8AccuracyKVZip
-1.2327.08415.423.716Oct 9, 2025
Updated 5mo ago

Evaluation results

MethodLinks
KVZipKV Cache Budget Sparsity=0.42025.1030.8
RLKVKV Cache Budget Sparsity=0.62025.1027.6
RLKVKV Cache Budget Sparsity=0.42025.1027.2
RLKVKV Cache Budget Sparsity=0.22025.1027
KVZipKV Cache Budget Sparsity=0.22025.1026.8
R-KVKV Cache Budget Sparsity=0.22025.1026.2
DuoAttentionKV Cache Budget Sparsity=0.22025.1026.2
H2OKV Cache Budget Sparsity=0.22025.1025.8
KVZipKV Cache Budget Sparsity=0.62025.1023.4
R-KVKV Cache Budget Sparsity=0.42025.1022
H2OKV Cache Budget Sparsity=0.42025.1019
DuoAttentionKV Cache Budget Sparsity=0.42025.1017.8
DuoAttentionKV Cache Budget Sparsity=0.42025.1015.6
H2OKV Cache Budget Sparsity=0.22025.1013.8
DuoAttentionKV Cache Budget Sparsity=0.62025.1013.8
RLKVKV Cache Budget Sparsity=0.42025.1012.6
R-KVKV Cache Budget Sparsity=0.22025.1012
RLKVKV Cache Budget Sparsity=0.22025.1011.8
H2OKV Cache Budget Sparsity=0.42025.1011.4
KVZipKV Cache Budget Sparsity=0.22025.1010.8
DuoAttentionKV Cache Budget Sparsity=0.62025.1010.6
DuoAttentionKV Cache Budget Sparsity=0.22025.109.8
RLKVKV Cache Budget Sparsity=0.62025.109.8
R-KVKV Cache Budget Sparsity=0.62025.109.6
KVZipKV Cache Budget Sparsity=0.42025.109
H2OKV Cache Budget Sparsity=0.62025.109
R-KVKV Cache Budget Sparsity=0.42025.107.6
RLKVKV Cache Budget Sparsity=0.82025.107.4
R-KVKV Cache Budget Sparsity=0.62025.103.8
KVZipKV Cache Budget Sparsity=0.62025.103.8
H2OKV Cache Budget Sparsity=0.62025.103
DuoAttentionKV Cache Budget Sparsity=0.82025.102.4
RLKVKV Cache Budget Sparsity=0.82025.102.4
DuoAttentionKV Cache Budget Sparsity=0.82025.101.8
R-KVKV Cache Budget Sparsity=0.82025.100.8
KVZipKV Cache Budget Sparsity=0.82025.100.4
R-KVKV Cache Budget Sparsity=0.82025.100.2
KVZipKV Cache Budget Sparsity=0.82025.100.2
H2OKV Cache Budget Sparsity=0.82025.100
H2OKV Cache Budget Sparsity=0.82025.100