General Reasoning on ARC (Pass@1)
96.2Pass@1Qwen3
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3Base Model=8B, Training Method=Base2025.10 | 96.2 | |
| GRPOBase Model=8B, Training Method=GRPO2025.10 | 95.8 | |
| GRPOExtraRolloutsBase Model=8B, Training Method=GRPOExtraRollouts2025.10 | 95.7 | |
| ICPO†Base Model=8B, Training Method=ICPO†2025.10 | 95.6 | |
| ICPOBase Model=8B, Training Method=ICPO2025.10 | 95.5 | |
| GRPOExpertDomainBase Model=8B, Training Method=GRPOExpertDomain2025.10 | 92.2 | |
| GRPOExtraRolloutsBase Model=1.7B, Training Method=GRPOExtraRollouts2025.10 | 88.9 | |
| GRPOExpertDomainBase Model=1.7B, Training Method=GRPOExpertDomain2025.10 | 88.8 | |
| Qwen3Base Model=1.7B, Training Method=Base2025.10 | 88.3 | |
| GRPOBase Model=1.7B, Training Method=GRPO2025.10 | 88.3 | |
| ICPOBase Model=1.7B, Training Method=ICPO2025.10 | 88.1 | |
| ICPO†Base Model=1.7B, Training Method=ICPO†2025.10 | 87.7 |