List your company

MAS Test-Time Scaling on HotpotQA

57AccuracyOracle (UB)
38.843.52548.2552.975Jun 11, 2026

Evaluation results

MethodLinks
Oracle (UB)Verification Level=Trajectory, N=82026.0657—
GPT-5.4-miniVerification Level=Orchestration, N=82026.06467.75
GPT-5-miniVerification Level=Trajectory, N=82026.064414.86
MAS-Orchestra (LB)Verification Level=-, N=82026.0642.5—
Maj. VoteVerification Level=Trajectory, N=82026.0642.5—
Orch-RMVerification Level=Orchestration, N=82026.0642.57.32
GPT-4.1-miniVerification Level=Orchestration, N=82026.06427.66
GPT-5.2Verification Level=Orchestration, N=82026.06427.77
Skywork-V2-Qwen3-4BVerification Level=Orchestration, N=82026.06427.32
Skywork-V2-Llama-3.2-3BVerification Level=Orchestration, N=82026.0641.57.32
Skywork-V2-Qwen3-8BVerification Level=Orchestration, N=82026.06417.32
GPT-5-miniVerification Level=Orchestration, N=82026.0640.57.69
Skywork-LLaMA-3.1-8BVerification Level=Orchestration, N=82026.0640.57.32
log PVerification Level=Orchestration, N=82026.0639.5—