MAS Test-Time Scaling on GPQA
84.85AccuracyOracle (UB)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Oracle (UB)Verification Level=Trajectory, N=82026.06 | 84.85 | — | |
| GPT-5-miniVerification Level=Orchestration, N=82026.06 | 71.72 | 7.88 | |
| log PVerification Level=Orchestration, N=82026.06 | 71.21 | — | |
| GPT-5-miniVerification Level=Trajectory, N=82026.06 | 68.89 | 29.76 | |
| Skywork-V2-Qwen3-4BVerification Level=Orchestration, N=82026.06 | 68.69 | 7.49 | |
| Skywork-V2-Qwen3-8BVerification Level=Orchestration, N=82026.06 | 68.18 | 7.49 | |
| GPT-5.4-miniVerification Level=Orchestration, N=82026.06 | 68.13 | 7.83 | |
| GPT-5.2Verification Level=Orchestration, N=82026.06 | 68.02 | 7.89 | |
| GPT-4.1-miniVerification Level=Orchestration, N=82026.06 | 67.68 | 7.85 | |
| Orch-RMVerification Level=Orchestration, N=82026.06 | 66.16 | 7.49 | |
| Skywork-LLaMA-3.1-8BVerification Level=Orchestration, N=82026.06 | 64.67 | 7.49 | |
| Skywork-V2-Llama-3.2-3BVerification Level=Orchestration, N=82026.06 | 64.65 | 7.49 | |
| MAS-Orchestra (LB)Verification Level=-, N=82026.06 | 63.63 | — | |
| Maj. VoteVerification Level=Trajectory, N=82026.06 | 63.63 | — |