Scientific Reasoning on GPQA (Acc., Maj. Vote)
67.42AccuracyMAS-Orchestra
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MAS-OrchestraContext=Training-from-scratch, Sampling Level=Trajectory2026.06 | 67.42 | 63.63 | |
| GRPOContext=Continued-training, Sampling Level=Trajectory2026.06 | 67.1 | 64.65 | |
| Orch-RMContext=Continued-training, Sampling Level=Orchestration2026.06 | 66.7 | 64.65 | |
| DPOContext=Continued-training2026.06 | 66.41 | 63.63 | |
| RFTContext=Continued-training, Sampling Level=Trajectory2026.06 | 66 | 63.13 | |
| Orch-RMContext=Training-from-scratch, Sampling Level=Orchestration2026.06 | 65.6 | 62.62 | |
| LLM-as-a-judgeContext=Continued-training, Sampling Level=Orchestration2026.06 | 63.19 | 60.1 | |
| Qwen2.5-7B-InstructContext=Base orchestrator2026.06 | 26.4 | 17.17 |