List your company
ResearchFormerly WizWand

Long-context understanding on LongBench (Average Score)

47.26Average ScoreLKV
29.018433.754238.4943.2258Apr 22, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.42026.0447.26
LKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.32026.0447.16
LKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.22026.0447.11
LKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.52026.0446.99
LKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.152026.0446.73
DuoAttentionBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.52026.0446.62
Ada-SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.52026.0446.04
SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.52026.0445.49
DuoAttentionBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.42026.0445.28
DuoAttentionBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.32026.0445.21
Ada-SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.42026.0445.02
SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.42026.0444.33
Ada-SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.32026.0444.01
LKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.12026.0443.93
SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.32026.0443.16
Ada-SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.22026.0441.32
SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.22026.0440.22
Ada-SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.152026.0439.06
SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.152026.0438.05
PyramidKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.52026.0438.01
PyramidKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.42026.0437.55
DuoAttentionBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.22026.0437.53
Ada-SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.12026.0436.28
PyramidKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.32026.0435.59
SnapKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.12026.0434.62
PyramidKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.22026.0433.41
PyramidKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.152026.0432.12
PyramidKVBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.12026.0431.97
DuoAttentionBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.152026.0431.03
DuoAttentionBase Model=Llama-3.1-8B-Instruct, Retention Ratio (R)=0.12026.0429.72