Mathematical Reasoning on Mathematical Reasoning Suite Overall
63.9Average ScoreSeirênes
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SeirênesBackbone=Qwen3-30B-A3B, same budget=true2026.05 | 63.9 | 7.2 | |
| DAPOBackbone=Qwen3-30B-A3B, same budget=true2026.05 | 60.1 | 3.4 | |
| SeirênesBackbone=Qwen3-4B-Instruct, same budget=true2026.05 | 58 | 10.2 | |
| Qwen3-30B-A3BBackbone=Qwen3-30B-A3B2026.05 | 56.7 | — | |
| Dr.GRPOBackbone=Qwen3-4B-Instruct, same budget=true2026.05 | 53.7 | 5.9 | |
| InTBackbone=Qwen3-4B-Instruct2026.05 | 53.3 | 5.5 | |
| DAPOBackbone=Qwen3-4B-Instruct, same budget=true2026.05 | 52.1 | 4.3 | |
| SAGEBackbone=Qwen3-4B-Instruct2026.05 | 48.2 | 0.4 | |
| Scaf-GRPOBackbone=Qwen3-4B-Instruct2026.05 | 48.1 | 0.3 | |
| Qwen3-4B-InstructBackbone=Qwen3-4B-Instruct2026.05 | 47.8 | — | |
| SeirênesBackbone=Qwen2.5-7B-Instruct, same budget=true2026.05 | 22.9 | 9.1 | |
| LUFFYBackbone=Qwen2.5-7B-Instruct2026.05 | 18.7 | 4.9 | |
| SAGEBackbone=Qwen2.5-7B-Instruct2026.05 | 18.6 | 4.8 | |
| ExGRPOBackbone=Qwen2.5-7B-Instruct2026.05 | 17.7 | 3.9 | |
| DAPOBackbone=Qwen2.5-7B-Instruct, same budget=true2026.05 | 17.4 | 3.6 | |
| Qwen2.5-7B-InstructBackbone=Qwen2.5-7B-Instruct2026.05 | 13.8 | — |