List your company
ResearchFormerly WizWand

Long-horizon agentic task on ResearchRubrics

49.36PerformanceAggAgent
31.014435.777240.5445.3028Apr 13, 2026
Updated 6mo ago

Evaluation results

MethodLinks
AggAgentBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0449.36
AggAgentBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0445.42
AggAgentBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0445.31
Solution AggregationBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0444
Best-of-NBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.0442.37
Solution AggregationBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0442.1
Pass@1Backbone=Qwen3.5-122B, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.0440.5
Summary AggregationBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0440.29
Pass@1Backbone=MiniMax-M2.5, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.0439.97
Fewest Tool CallsBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.0439.58
Best-of-NBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.0439
Fewest Tool CallsBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.0438.44
Best-of-NBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.0437.7
Pass@1Backbone=GLM-4.7-Flash, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.0437.47
Summary AggregationBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0437.47
Solution AggregationBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0436.84
Fewest Tool CallsBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.0435.21
Summary AggregationBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0431.72