List your company
ResearchFormerly WizWand

Long-context downstream performance on LongBench v1

27.5ScoreThriftAttention
12.21216.18120.1524.119May 21, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ThriftAttentionModel=Llama3.1 (8B), Budget (k)=10%2026.0527.5111.8
ThriftAttentionModel=Llama3.1 (8B), Budget (k)=5%2026.0527.1108.7
ThriftAttentionModel=Llama3.1 (8B), Budget (k)=25%2026.0527107.9
FP16Model=Llama3.2 (3B)2026.0526.7100
FP16Model=Ministral 3 (8B)2026.0526.7100
ThriftAttentionModel=Ministral 3 (8B), Budget (k)=25%2026.0526.497.8
ThriftAttentionModel=Ministral 3 (8B), Budget (k)=10%2026.0526.296.4
FP16Model=Llama3.1 (8B)2026.0526100
FP16Model=Qwen3 (4B)2026.0526100
ThriftAttentionModel=Ministral 3 (8B), Budget (k)=5%2026.0525.893.4
ThriftAttentionModel=Qwen3 (4B), Budget (k)=25%2026.0525.797.6
ThriftAttentionModel=Qwen3 (4B), Budget (k)=10%2026.0525.696.8
ThriftAttentionModel=Qwen3 (4B), Budget (k)=5%2026.0525.495.2
ThriftAttentionModel=Llama3.2 (3B), Budget (k)=5%2026.0525.288.9
ThriftAttentionModel=Llama3.2 (3B), Budget (k)=10%2026.0524.986.5
FP16Model=Qwen3 (8B)2026.0524.6100
ThriftAttentionModel=Qwen3 (8B), Budget (k)=25%2026.0524.296.6
ThriftAttentionModel=Qwen3 (8B), Budget (k)=10%2026.0524.195.8
ThriftAttentionModel=Llama3.2 (3B), Budget (k)=25%2026.052480
ThriftAttentionModel=Qwen3 (8B), Budget (k)=5%2026.0523.792.4
FP4Model=Qwen3 (4B)2026.0513.40
FP4Model=Llama3.1 (8B)2026.0513.30
FP4Model=Llama3.2 (3B)2026.0513.20
FP4Model=Ministral 3 (8B)2026.05130
FP4Model=Qwen3 (8B)2026.0512.80