Mathematical Reasoning on GSM-Infinite (8K)
22.9AccuracyTriangleMix
Evaluation Results
| Method | Links | |
|---|---|---|
| TriangleMixBackbone Model=Qwen2.5-7B-Inst2025.07 | 22.9 | |
| Ours + XAttentionBackbone Model=Qwen2.5-7B-Inst2025.07 | 21.6 | |
| Ours + MInferenceBackbone Model=Qwen2.5-7B-Inst2025.07 | 21.3 | |
| XAttentionBackbone Model=Qwen2.5-7B-Inst2025.07 | 21.3 | |
| Qwen2.5-7B-InstBackbone Model=Qwen2.5-7B-Inst2025.07 | 21 | |
| MInferenceBackbone Model=Qwen2.5-7B-Inst2025.07 | 20.4 | |
| Ours + FlexPrefillBackbone Model=Qwen2.5-7B-Inst2025.07 | 18.6 | |
| FlexPrefillBackbone Model=Qwen2.5-7B-Inst2025.07 | 17.7 | |
| FlexPrefillBackbone Model=Llama-3.1-8B-Inst2025.07 | 8.6 | |
| Ours + XAttentionBackbone Model=Llama-3.1-8B-Inst2025.07 | 7.6 | |
| XAttentionBackbone Model=Llama-3.1-8B-Inst2025.07 | 7.3 | |
| TriangleMixBackbone Model=Llama-3.1-8B-Inst2025.07 | 7 | |
| Llama-3.1-8B-InstBackbone Model=Llama-3.1-8B-Inst2025.07 | 6.9 | |
| MInferenceBackbone Model=Llama-3.1-8B-Inst2025.07 | 6.5 | |
| Ours + MInferenceBackbone Model=Llama-3.1-8B-Inst2025.07 | 6.3 | |
| Ours + FlexPrefillBackbone Model=Llama-3.1-8B-Inst2025.07 | 6.3 | |
| FlexPrefillBackbone Model=Llama-3-8B-Inst-262k2025.07 | 5.3 | |
| Ours + MInferenceBackbone Model=Llama-3-8B-Inst-262k2025.07 | 3.8 | |
| Ours + FlexPrefillBackbone Model=Llama-3-8B-Inst-262k2025.07 | 3.8 | |
| Llama-3-8B-Inst-262kBackbone Model=Llama-3-8B-Inst-262k2025.07 | 3.7 | |
| XAttentionBackbone Model=Llama-3-8B-Inst-262k2025.07 | 3.5 | |
| TriangleMixBackbone Model=Llama-3-8B-Inst-262k2025.07 | 3.4 | |
| MInferenceBackbone Model=Llama-3-8B-Inst-262k2025.07 | 3.4 | |
| Ours + XAttentionBackbone Model=Llama-3-8B-Inst-262k2025.07 | 3.4 |