List your company
ResearchFormerly WizWand

Long-horizon agentic task on Healthbench Hard

28.06PerformanceAggAgent
4.431210.565616.722.8344Apr 13, 2026
Updated 6mo ago

Evaluation results

MethodLinks
AggAgentBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0428.06
AggAgentBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0427.99
Solution AggregationBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0426.3
AggAgentBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0424.46
Summary AggregationBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0423
Solution AggregationBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0421.84
Summary AggregationBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0416.92
Solution AggregationBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.0415.72
Best-of-NBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.0413.01
Pass@1Backbone=Qwen3.5-122B, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.0412.87
Fewest Tool CallsBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.0412.83
Best-of-NBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.049.91
Pass@1Backbone=MiniMax-M2.5, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.049.67
Fewest Tool CallsBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.048.9
Best-of-NBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.048.79
Pass@1Backbone=GLM-4.7-Flash, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.048.67
Summary AggregationBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.047.35
Fewest Tool CallsBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.045.34