Long-context understanding on LongBench E (Functional Metrics & Latency)
52.28Single Doc QATCA-Attention
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| TCA-AttentionModel=LLaMA3.1-8B-Instruct, Context Length=64K2025.12 | 52.28 | 52.83 | 30.84 | 68.4 | 54.86 | 61.82 | 53.51 | 120.96 | |
| MInferenceModel=LLaMA3.1-8B-Instruct, Context Length=64K2025.12 | 51.7 | 52.72 | 30.76 | 68.58 | 53.5 | 61.12 | 53.06 | 324.84 | |
| LLaMA3.1-8B-InstructModel=LLaMA3.1-8B-Instruct, Attention=Full, Context Length=64K2025.12 | 51.63 | 53.23 | 30.78 | 68.67 | 54.29 | 60.52 | 53.19 | 316.14 | |
| FlexPrefillModel=LLaMA3.1-8B-Instruct, Context Length=64K2025.12 | 50.35 | 52.85 | 30.71 | 68.41 | 54.3 | 62.76 | 53.23 | 280.11 | |
| XAttentionModel=LLaMA3.1-8B-Instruct, Context Length=64K2025.12 | 49.96 | 51.98 | 31.22 | 68.07 | 48.5 | 55.75 | 50.91 | 133.85 | |
| FlexPrefillModel=Qwen2.5-7B-Instruct, Context Length=64K2025.12 | 49.08 | 52.16 | 27.86 | 65.18 | 52 | 62.2 | 51.41 | 244.37 | |
| MInferenceModel=Qwen2.5-7B-Instruct, Context Length=64K2025.12 | 48.8 | 52.37 | 27.64 | 64.67 | 51.5 | 62.08 | 51.18 | 292.33 | |
| Qwen2.5-7B-InstructModel=Qwen2.5-7B-Instruct, Attention=Full, Context Length=64K2025.12 | 48.75 | 52.24 | 27.81 | 65 | 52 | 61.14 | 51.16 | 268.55 | |
| XAttentionModel=Qwen2.5-7B-Instruct, Context Length=64K2025.12 | 48.5 | 50.08 | 27.48 | 66.4 | 50.5 | 60.98 | 50.66 | 119.87 | |
| TCA-AttentionModel=Qwen2.5-7B-Instruct, Context Length=64K2025.12 | 48.5 | 52.91 | 27.74 | 64.92 | 52.25 | 62.74 | 51.51 | 105.93 |