List your company
ResearchFormerly WizWand

Code Generation on MBPP (Performance %)

83Performance (%)DuoAttention
-3.3219.0941.563.91Oct 9, 2025
Updated 5mo ago

Evaluation results

MethodLinks
DuoAttentionKV Cache Budget Sparsity=0.22025.1083
RLKVKV Cache Budget Sparsity=0.22025.1082.4
RLKVKV Cache Budget Sparsity=0.42025.1081
KVZipKV Cache Budget Sparsity=0.22025.1078.2
DuoAttentionKV Cache Budget Sparsity=0.42025.1076.4
KVZipKV Cache Budget Sparsity=0.42025.1074.4
R-KVKV Cache Budget Sparsity=0.22025.1067
RLKVKV Cache Budget Sparsity=0.4, Backbone=Llama-3.1-8B-R12025.1063.8
KVZipKV Cache Budget Sparsity=0.62025.1063.8
RLKVKV Cache Budget Sparsity=0.22025.1063.2
RLKVKV Cache Budget Sparsity=0.2, Backbone=Llama-3.1-8B-R12025.1062.8
DuoAttentionKV Cache Budget Sparsity=0.2, Backbone=Llama-3.1-8B-R12025.1062
DuoAttentionKV Cache Budget Sparsity=0.4, Backbone=Llama-3.1-8B-R12025.1060.6
DuoAttentionKV Cache Budget Sparsity=0.22025.1060.4
KVZipKV Cache Budget Sparsity=0.2, Backbone=Llama-3.1-8B-R12025.1059.8
KVZipKV Cache Budget Sparsity=0.4, Backbone=Llama-3.1-8B-R12025.1057.8
RLKVKV Cache Budget Sparsity=0.42025.1056.8
KVZipKV Cache Budget Sparsity=0.22025.1056.6
RLKVKV Cache Budget Sparsity=0.62025.1055.2
DuoAttentionKV Cache Budget Sparsity=0.42025.1055
RLKVKV Cache Budget Sparsity=0.6, Backbone=Llama-3.1-8B-R12025.1051.8
KVZipKV Cache Budget Sparsity=0.42025.1050
R-KVKV Cache Budget Sparsity=0.42025.1046.6
R-KVKV Cache Budget Sparsity=0.2, Backbone=Llama-3.1-8B-R12025.1046.4
R-KVKV Cache Budget Sparsity=0.22025.1041.4
DuoAttentionKV Cache Budget Sparsity=0.6, Backbone=Llama-3.1-8B-R12025.1040.4
RLKVKV Cache Budget Sparsity=0.62025.1040.2
DuoAttentionKV Cache Budget Sparsity=0.62025.1039.8
KVZipKV Cache Budget Sparsity=0.6, Backbone=Llama-3.1-8B-R12025.1039.6
KVZipKV Cache Budget Sparsity=0.62025.1039.2
DuoAttentionKV Cache Budget Sparsity=0.62025.1035
R-KVKV Cache Budget Sparsity=0.42025.1031
R-KVKV Cache Budget Sparsity=0.4, Backbone=Llama-3.1-8B-R12025.1029.4
R-KVKV Cache Budget Sparsity=0.6, Backbone=Llama-3.1-8B-R12025.1014.6
KVZipKV Cache Budget Sparsity=0.8, Backbone=Llama-3.1-8B-R12025.1012.6
H2OKV Cache Budget Sparsity=0.22025.1012.6
R-KVKV Cache Budget Sparsity=0.62025.1012.2
R-KVKV Cache Budget Sparsity=0.62025.1010.8
DuoAttentionKV Cache Budget Sparsity=0.8, Backbone=Llama-3.1-8B-R12025.107.4
H2OKV Cache Budget Sparsity=0.2, Backbone=Llama-3.1-8B-R12025.107.2
RLKVKV Cache Budget Sparsity=0.8, Backbone=Llama-3.1-8B-R12025.106
H2OKV Cache Budget Sparsity=0.22025.105.2
H2OKV Cache Budget Sparsity=0.42025.101.6
R-KVKV Cache Budget Sparsity=0.8, Backbone=Llama-3.1-8B-R12025.101
DuoAttentionKV Cache Budget Sparsity=0.82025.101
DuoAttentionKV Cache Budget Sparsity=0.82025.101
RLKVKV Cache Budget Sparsity=0.82025.101
H2OKV Cache Budget Sparsity=0.4, Backbone=Llama-3.1-8B-R12025.100.6
RLKVKV Cache Budget Sparsity=0.82025.100.6
R-KVKV Cache Budget Sparsity=0.82025.100.4
KVZipKV Cache Budget Sparsity=0.82025.100.4
H2OKV Cache Budget Sparsity=0.42025.100.4
KVZipKV Cache Budget Sparsity=0.82025.100.4
H2OKV Cache Budget Sparsity=0.62025.100.2
R-KVKV Cache Budget Sparsity=0.82025.100.2
H2OKV Cache Budget Sparsity=0.6, Backbone=Llama-3.1-8B-R12025.100
H2OKV Cache Budget Sparsity=0.8, Backbone=Llama-3.1-8B-R12025.100
H2OKV Cache Budget Sparsity=0.82025.100
H2OKV Cache Budget Sparsity=0.62025.100
H2OKV Cache Budget Sparsity=0.82025.100