List your company
ResearchFormerly WizWand

Multiple-choice Question Answering on MMLU-Pro Phys.

70.4Accuracy (%)KVZip
-2.81616.19235.254.208Oct 9, 2025
Updated 5mo ago

Evaluation results

MethodLinks
KVZipKV Cache Budget Sparsity=0.42025.1070.4
RLKVKV Cache Budget Sparsity=0.42025.1069.8
RLKVKV Cache Budget Sparsity=0.22025.1066.8
DuoAttentionKV Cache Budget Sparsity=0.22025.1066.6
KVZipKV Cache Budget Sparsity=0.22025.1066.6
RLKVKV Cache Budget Sparsity=0.62025.1064.2
DuoAttentionKV Cache Budget Sparsity=0.42025.1062.8
R-KVKV Cache Budget Sparsity=0.22025.1061.6
RLKVKV Cache Budget Sparsity=0.22025.1056.8
RLKVKV Cache Budget Sparsity=0.42025.1053.8
KVZipKV Cache Budget Sparsity=0.62025.1053.4
DuoAttentionKV Cache Budget Sparsity=0.22025.1052.4
KVZipKV Cache Budget Sparsity=0.22025.1051
R-KVKV Cache Budget Sparsity=0.42025.1050.4
R-KVKV Cache Budget Sparsity=0.22025.1049.2
DuoAttentionKV Cache Budget Sparsity=0.42025.1047.6
KVZipKV Cache Budget Sparsity=0.42025.1044.6
R-KVKV Cache Budget Sparsity=0.42025.1038.2
RLKVKV Cache Budget Sparsity=0.62025.1037
DuoAttentionKV Cache Budget Sparsity=0.62025.1034.6
DuoAttentionKV Cache Budget Sparsity=0.62025.1026
H2OKV Cache Budget Sparsity=0.22025.1025.6
H2OKV Cache Budget Sparsity=0.22025.1024.8
R-KVKV Cache Budget Sparsity=0.62025.1024.2
R-KVKV Cache Budget Sparsity=0.62025.1023.4
KVZipKV Cache Budget Sparsity=0.62025.1019.4
H2OKV Cache Budget Sparsity=0.42025.1013.2
H2OKV Cache Budget Sparsity=0.42025.1011.4
RLKVKV Cache Budget Sparsity=0.82025.108.4
H2OKV Cache Budget Sparsity=0.62025.105.6
H2OKV Cache Budget Sparsity=0.62025.104.6
DuoAttentionKV Cache Budget Sparsity=0.82025.103
R-KVKV Cache Budget Sparsity=0.82025.102.2
DuoAttentionKV Cache Budget Sparsity=0.82025.102.2
R-KVKV Cache Budget Sparsity=0.82025.101.6
H2OKV Cache Budget Sparsity=0.82025.101.4
RLKVKV Cache Budget Sparsity=0.82025.101.2
KVZipKV Cache Budget Sparsity=0.82025.100.4
H2OKV Cache Budget Sparsity=0.82025.100.2
KVZipKV Cache Budget Sparsity=0.82025.100