Long-horizon agentic task on BrowseComp
71.33PerformanceAggAgent
Evaluation Results
| Method | Links | |
|---|---|---|
| AggAgentBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 71.33 | |
| Best-of-NBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 70.67 | |
| Solution AggregationBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 70.67 | |
| Summary AggregationBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 70 | |
| Fewest Tool CallsBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 67.33 | |
| Weighted VotingBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 66.67 | |
| AggAgentBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 62.67 | |
| Summary AggregationBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 62 | |
| Solution AggregationBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 61.33 | |
| Majority VotingBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 60.67 | |
| Weighted VotingBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 60 | |
| Best-of-NBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 58.67 | |
| AggAgentBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 56 | |
| Fewest Tool CallsBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 56 | |
| Summary AggregationBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 55.33 | |
| Solution AggregationBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 53.33 | |
| Best-of-NBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 51.33 | |
| Weighted VotingBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 50.67 | |
| Pass@1Backbone=MiniMax-M2.5, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.04 | 50.17 | |
| Majority VotingBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 47.33 | |
| Fewest Tool CallsBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 41.33 | |
| Pass@1Backbone=Qwen3.5-122B, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.04 | 40.25 | |
| Majority VotingBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 32.67 | |
| Pass@1Backbone=GLM-4.7-Flash, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.04 | 27.42 |