List your company
ResearchFormerly WizWand

Multiple-choice Question Answering on MMLU-Pro Chem.

72.8AccuracyDuoAttention
-2.91216.74436.456.056Oct 9, 2025
Updated 5mo ago

Evaluation results

MethodLinks
DuoAttentionKV Cache Budget Sparsity=0.22025.1072.8
RLKVKV Cache Budget Sparsity=0.42025.1072.2
KVZipKV Cache Budget Sparsity=0.42025.1070.8
KVZipKV Cache Budget Sparsity=0.22025.1069
R-KVKV Cache Budget Sparsity=0.22025.1065
RLKVKV Cache Budget Sparsity=0.22025.1064.6
RLKVKV Cache Budget Sparsity=0.62025.1062.6
DuoAttentionKV Cache Budget Sparsity=0.42025.1062.4
KVZipKV Cache Budget Sparsity=0.62025.1056
RLKVKV Cache Budget Sparsity=0.22025.1055
KVZipKV Cache Budget Sparsity=0.22025.1051
RLKVKV Cache Budget Sparsity=0.42025.1050.8
R-KVKV Cache Budget Sparsity=0.42025.1049.8
DuoAttentionKV Cache Budget Sparsity=0.22025.1047.4
DuoAttentionKV Cache Budget Sparsity=0.42025.1044.8
R-KVKV Cache Budget Sparsity=0.22025.1043.4
KVZipKV Cache Budget Sparsity=0.42025.1041.2
RLKVKV Cache Budget Sparsity=0.62025.1036
R-KVKV Cache Budget Sparsity=0.42025.1032.8
DuoAttentionKV Cache Budget Sparsity=0.62025.1032.8
DuoAttentionKV Cache Budget Sparsity=0.62025.1024.8
KVZipKV Cache Budget Sparsity=0.62025.1022.8
H2OKV Cache Budget Sparsity=0.22025.1021.6
R-KVKV Cache Budget Sparsity=0.62025.1019.8
H2OKV Cache Budget Sparsity=0.22025.1018.8
R-KVKV Cache Budget Sparsity=0.62025.1017.4
H2OKV Cache Budget Sparsity=0.42025.109
RLKVKV Cache Budget Sparsity=0.82025.107.4
H2OKV Cache Budget Sparsity=0.42025.107.2
H2OKV Cache Budget Sparsity=0.62025.103
H2OKV Cache Budget Sparsity=0.62025.102.8
DuoAttentionKV Cache Budget Sparsity=0.82025.102.2
DuoAttentionKV Cache Budget Sparsity=0.82025.101.4
R-KVKV Cache Budget Sparsity=0.82025.101
R-KVKV Cache Budget Sparsity=0.82025.100.8
H2OKV Cache Budget Sparsity=0.82025.100.4
KVZipKV Cache Budget Sparsity=0.82025.100.4
RLKVKV Cache Budget Sparsity=0.82025.100.4
KVZipKV Cache Budget Sparsity=0.82025.100.2
H2OKV Cache Budget Sparsity=0.82025.100