Competition Math Evaluation Suite (AIME, Brumo, HMMT)
71.2AIME ScoreParaGator-4B-Instruct-Principia + aggregation
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ParaGator-4B-Instruct-Principia + aggregationBackbone=Qwen3-4B-Instruct-2507, Aggregation=Enabled2026.03 | 71.2 | 46.65 | 66.28 | 61.38 | |
| Online Multitask + aggregationBackbone=Qwen3-4B-Instruct-2507, Aggregation=Enabled2026.03 | 64.24 | 45.26 | 67.33 | 58.94 | |
| Dr.GRPO (with KL) + aggregationBackbone=Qwen3-4B-Instruct-2507, Aggregation=Enabled2026.03 | 63.65 | 47.29 | 65.52 | 58.79 | |
| Offline aggregation (AggLM) + aggregationBackbone=Qwen3-4B-Instruct-2507, Aggregation=Enabled2026.03 | 62.42 | 43.16 | 65.14 | 56.91 | |
| ParaGator-4B-Instruct-PrincipiaBackbone=Qwen3-4B-Instruct-2507, Aggregation=None2026.03 | 59.44 | 42.32 | 59.67 | 53.81 | |
| Online MultitaskBackbone=Qwen3-4B-Instruct-2507, Aggregation=None2026.03 | 58.36 | 41.73 | 59.45 | 53.18 | |
| Dr.GRPO (with KL)Backbone=Qwen3-4B-Instruct-2507, Aggregation=None2026.03 | 58.02 | 44.69 | 61.56 | 54.2 | |
| Qwen3-4B-Instruct-2507 + aggregationBackbone=Qwen3-4B-Instruct-2507, Aggregation=Enabled2026.03 | 56.46 | 35.94 | 61.88 | 51.43 | |
| Offline aggregation (AggLM)Backbone=Qwen3-4B-Instruct-2507, Aggregation=None2026.03 | 51.06 | 37.47 | 54.91 | 47.81 | |
| Qwen3-4B-Instruct-2507Backbone=Qwen3-4B-Instruct-2507, Aggregation=None2026.03 | 47.71 | 30.83 | 55.42 | 44.65 | |
| ParaGator-Zero-4B-Principia + aggregationBackbone=Qwen3-4B-Base, Aggregation=Enabled2026.03 | 27.96 | 31.06 | — | 23.72 | |
| Online Multitask + aggregationBackbone=Qwen3-4B-Base, Aggregation=Enabled2026.03 | 26.19 | 29.54 | 14.11 | 23.28 | |
| Dr.GRPO + aggregationBackbone=Qwen3-4B-Base, Aggregation=Enabled2026.03 | 25.95 | 31.07 | 13.1 | 23.37 | |
| ParaGator-Zero-4B-PrincipiaBackbone=Qwen3-4B-Base, Aggregation=None2026.03 | 21.05 | 22.58 | 7.04 | 16.89 | |
| Dr.GRPOBackbone=Qwen3-4B-Base, Aggregation=None2026.03 | 20.93 | 23.19 | 8.14 | 17.42 | |
| Online MultitaskBackbone=Qwen3-4B-Base, Aggregation=None2026.03 | 19.14 | 22.37 | 7.98 | 16.5 | |
| Offline aggregation (AggLM) + aggregationBackbone=Qwen3-4B-Base, Aggregation=Enabled2026.03 | 16.91 | 25.65 | 12.4 | 18.32 | |
| Qwen3-4B-Base + aggregationBackbone=Qwen3-4B-Base, Aggregation=Enabled2026.03 | 10.3 | 14.25 | 2.5 | 9.02 | |
| Offline aggregation (AggLM)Backbone=Qwen3-4B-Base, Aggregation=None2026.03 | 9.13 | 17.11 | 7.42 | 11.22 | |
| Qwen3-4B-BaseBackbone=Qwen3-4B-Base, Aggregation=None2026.03 | 8.2 | 16.67 | 3.2 | 9.36 |