Web-based QA on BrowseComp+
10AccuracyOrch-RM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Orch-RMContext=Continued-training, Sampling Level=Orchestration2026.06 | 10 | 11 | |
| LLM-as-a-judgeContext=Continued-training, Sampling Level=Orchestration2026.06 | 9.63 | 9 | |
| DPOContext=Continued-training2026.06 | 9.56 | 9 | |
| MAS-OrchestraContext=Training-from-scratch, Sampling Level=Trajectory2026.06 | 9.44 | 9.5 | |
| RFTContext=Continued-training, Sampling Level=Trajectory2026.06 | 7.31 | 6 | |
| GRPOContext=Continued-training, Sampling Level=Trajectory2026.06 | 6.94 | 6 | |
| Orch-RMContext=Training-from-scratch, Sampling Level=Orchestration2026.06 | 5.94 | 4.5 | |
| Qwen2.5-7B-InstructContext=Base orchestrator2026.06 | 3.13 | 0.5 |