Long-context understanding on LongBench 32k 2024
57.62HotpotQA ScoreQwen2.5
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Qwen2.5Params=7B, Complexity Type=Quadratic, Context Truncation=32k2025.09 | 57.62 | 27.96 | 85.92 | 68.5 | 23.79 | 45.13 | |
| SpikingBrain-76BParams=12B/76B, Complexity Type=Hybrid, Context Truncation=32k2025.09 | 50 | 23.92 | 90.84 | 67 | 25.89 | 39.59 | |
| MixtralParams=13B/47B, Complexity Type=Quadratic, Context Truncation=32k2025.09 | 36.42 | 7.44 | 85.97 | 19.25 | 26.52 | 28.37 | |
| JambaParams=12B/52B, Complexity Type=Hybrid, Context Truncation=32k2025.09 | 11.38 | 3.73 | 92.63 | 77 | 8.44 | 10.67 |