Accuracy on LongBench (Long-context understanding)
33.9AccuracyBLASST
Evaluation results
| Method | Links | |
|---|---|---|
| BLASSTBackbone=Qwen3-8B, Attention Method=BLASST, Sparsity=~50%, Phase=Decode2025.12 | 33.9 | |
| Dense AttentionBackbone=Qwen3-8B, Attention Method=Dense, Phase=Decode2025.12 | 33.6 | |
| RocketKVBackbone=Qwen3-8B, Attention Method=RocketKV, Phase=Decode2025.12 | 30.6 | |
| QuestBackbone=Qwen3-8B, Attention Method=Quest, Phase=Decode2025.12 | 30.3 |