HLE on HLE
67.1AccuracyPass
Evaluation results
| Method | Links | |
|---|---|---|
| PassK=8, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 67.1 | |
| PassK=4, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 59.87 | |
| AggAgentK=8, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 54.19 | |
| BoNK=8, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 53.55 | |
| AggAgentK=4, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 51.4 | |
| SolAggK=8, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 50.97 | |
| SummAggK=8, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 50.32 | |
| PassK=2, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 50.12 | |
| SolAggK=4, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 49.25 | |
| SummAggK=4, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 47.96 | |
| BoNK=4, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 47.43 | |
| AggAgentK=2, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 45.81 | |
| SummAggK=2, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 45.59 | |
| WMVK=4, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 45.28 | |
| SolAggK=2, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 45.16 | |
| WMVK=8, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 45.16 | |
| MVK=8, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 43.87 | |
| WMVK=2, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 43.71 | |
| BoNK=2, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 43.71 | |
| MVK=4, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 42.29 | |
| FewToolK=8, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 41.29 | |
| PassK=1, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 39.35 | |
| FewToolK=4, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 39.3 | |
| FewToolK=2, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 39.26 | |
| MVK=2, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 39.19 |