DeepSearchQA on DeepSearchQA
76.67AccuracyPass
Evaluation Results
| Method | Links | |
|---|---|---|
| PassK=8, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 76.67 | |
| PassK=4, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 70.02 | |
| AggAgentK=8, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 66 | |
| SummAggK=8, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 64 | |
| SolAggK=8, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 62.67 | |
| PassK=2, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 60.76 | |
| AggAgentK=4, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 59.56 | |
| SummAggK=4, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 58.67 | |
| BoNK=8, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 57.33 | |
| BoNK=4, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 56.09 | |
| SolAggK=4, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 56 | |
| AggAgentK=2, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 55.56 | |
| FewToolK=8, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 54.67 | |
| FewToolK=4, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 53.67 | |
| BoNK=2, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 53.33 | |
| SummAggK=2, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 52.89 | |
| SolAggK=2, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 52.67 | |
| FewToolK=2, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 52.17 | |
| PassK=1, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 49.25 |