Mathematics on HMMT 2026
58.7AccuracyFixed Interval Summary
Evaluation results
| Method | Links | |
|---|---|---|
| Fixed Interval SummaryModel=Qwen3-30B-A3B-Instruct-2507, Avg. tokens per question=26k, Thinking state=Enabled2026.06 | 58.7 | |
| SELFCOMPACTModel=Qwen3-30B-A3B-Instruct-2507, Avg. tokens per question=29k, Thinking state=Enabled2026.06 | 57.6 | |
| pass@32k=322026.06 | 52.3 | |
| SELFCOMPACTModel=Qwen3.5-9B, Avg. tokens per question=93k, Thinking state=Disabled2026.06 | 52.3 | |
| No CompactionModel=Qwen3-30B-A3B-Instruct-2507, Avg. tokens per question=16k, Thinking state=Enabled2026.06 | 51.9 | |
| Fixed Interval SummaryModel=Qwen3.5-9B, Avg. tokens per question=90k, Thinking state=Disabled2026.06 | 44.9 | |
| SELFCOMPACTModel=Qwen3-4B-Instruct-2507, Avg. tokens per question=48k, Thinking state=Enabled2026.06 | 42.1 | |
| Fixed Interval SummaryModel=Qwen3-4B-Instruct-2507, Avg. tokens per question=44k, Thinking state=Enabled2026.06 | 39.2 | |
| No CompactionModel=Qwen3-4B-Instruct-2507, Avg. tokens per question=16k, Thinking state=Enabled2026.06 | 36.5 | |
| iS@1k=12026.06 | 34.8 | |
| No CompactionModel=Qwen3.5-9B, Avg. tokens per question=16k, Thinking state=Disabled2026.06 | 34.2 | |
| SELFCOMPACTModel=Qwen3.5-4B, Avg. tokens per question=67k, Thinking state=Disabled2026.06 | 30 | |
| SCsamples=322026.06 | 29.5 | |
| Fixed Interval SummaryModel=Qwen3.5-4B, Avg. tokens per question=64k, Thinking state=Disabled2026.06 | 29.1 | |
| pass@1k=12026.06 | 28.5 | |
| No CompactionModel=Qwen3.5-4B, Avg. tokens per question=16k, Thinking state=Disabled2026.06 | 22.5 |