Long-horizon agentic task on BrowseComp-Plus
77.33PerformanceAggAgent
Evaluation Results
| Method | Links | |
|---|---|---|
| AggAgentBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 77.33 | |
| Solution AggregationBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 76.67 | |
| Summary AggregationBackbone=MiniMax-M2.5, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 76.67 | |
| Best-of-NBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 76 | |
| Weighted VotingBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 75.33 | |
| AggAgentBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 74.67 | |
| Fewest Tool CallsBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 74.67 | |
| Best-of-NBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 74 | |
| Solution AggregationBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 73.33 | |
| Summary AggregationBackbone=Qwen3.5-122B, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 73.33 | |
| AggAgentBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 71.33 | |
| Solution AggregationBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 70.67 | |
| Summary AggregationBackbone=GLM-4.7-Flash, Aggregation Category=LLM-based Aggregation, Number of Rollouts (K)=82026.04 | 70.67 | |
| Fewest Tool CallsBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 70.67 | |
| Weighted VotingBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 69.33 | |
| Weighted VotingBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 68.67 | |
| Best-of-NBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 68.67 | |
| Majority VotingBackbone=MiniMax-M2.5, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 68.67 | |
| Majority VotingBackbone=Qwen3.5-122B, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 66.67 | |
| Pass@1Backbone=MiniMax-M2.5, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.04 | 64.17 | |
| Fewest Tool CallsBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 62 | |
| Majority VotingBackbone=GLM-4.7-Flash, Aggregation Category=Heuristic Aggregation, Number of Rollouts (K)=82026.04 | 59.33 | |
| Pass@1Backbone=Qwen3.5-122B, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.04 | 58.67 | |
| Pass@1Backbone=GLM-4.7-Flash, Aggregation Category=Single Rollout, Number of Rollouts (K)=12026.04 | 49.08 |