Math Problem Solving on Aggregated Benchmarks (AIME24, Math-OAI, Minerva, Olympiad, ACM23)
7.71AIME24 ScoreInstructDiff
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| InstructDiffBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 7.71 | 61.79 | 21.42 | 26.94 | 40.31 | 31.63 | |
| PPLMidBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 6.05 | 54.76 | 13.61 | 21.01 | 32.81 | 25.65 | |
| EntropyMinBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 5.83 | 60.74 | 18.59 | 27.13 | 36.72 | 29.8 | |
| PPLMinBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 5.63 | 57.8 | 16.35 | 23.68 | 31.72 | 27.04 | |
| RandomBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 5.43 | 55.41 | 14.86 | 20.18 | 33.13 | 25.8 | |
| ALLBackbone=Qwen2.5-7B, Selection Ratio=100%2026.01 | 5 | 57.93 | 17.83 | 22.3 | 32.19 | 27.05 | |
| SuperfilteringBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 4.8 | 55.55 | 14.06 | 21.38 | 30.78 | 25.31 | |
| Inst LenMaxBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 4.79 | 54.98 | 12.27 | 20.99 | 29.53 | 24.51 | |
| SelectITBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 4.15 | 52.86 | 15.06 | 20.29 | 29.38 | 24.35 | |
| ZIPBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 4.15 | 50.3 | 12.23 | 16.69 | 30 | 22.61 | |
| PPLMaxBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 3.95 | 50.56 | 12.77 | 18.57 | 28.28 | 22.83 | |
| Inst/RespMinBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 3.74 | 52.5 | 12.27 | 20.14 | 27.97 | 23.32 | |
| EntropyMidBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 3.54 | 54.5 | 12.27 | 20.12 | 29.38 | 23.96 | |
| Inst/RespMaxBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 3.33 | 50.33 | 12.08 | 16.96 | 28.28 | 22.2 | |
| EntropyMaxBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 3.12 | 50.5 | 12.41 | 18.54 | 23.59 | 21.63 | |
| IFDBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 3.12 | 50.36 | 13.98 | 18.14 | 24.38 | 21.99 | |
| Resp LenMaxBackbone=Qwen2.5-7B, Selection Ratio=10%2026.01 | 2.28 | 44.65 | 10.02 | 15.38 | 21.56 | 18.78 | |
| Base ModelBackbone=Qwen2.5-7B2026.01 | 1.65 | 28.79 | 9.26 | 7.69 | 15.65 | 12.61 |