Accuracy Evaluation on ResearchRubrics
50.97AccuracyPass
Evaluation Results
| Method | Links | |
|---|---|---|
| PassK=8, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 50.97 | |
| AggAgentK=8, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 49.36 | |
| PassK=4, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 48.11 | |
| AggAgentK=4, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 46.61 | |
| PassK=2, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 44.77 | |
| AggAgentK=2, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 44.49 | |
| BoNK=8, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 42.37 | |
| SolAggK=8, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 42.1 | |
| SolAggK=4, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 41.41 | |
| SolAggK=2, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 41.17 | |
| BoNK=4, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 40.88 | |
| BoNK=2, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 40.71 | |
| PassK=1, Model=Qwen3.5-122B, Aggregation Strategy=None2026.04 | 40.5 | |
| FewToolK=2, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 40.02 | |
| FewToolK=4, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 39.77 | |
| FewToolK=8, Model=Qwen3.5-122B, Aggregation Strategy=Heuristic Aggregation2026.04 | 39.58 | |
| SummAggK=8, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 37.47 | |
| SummAggK=4, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 36.29 | |
| SummAggK=2, Model=Qwen3.5-122B, Aggregation Strategy=LLM-based Aggregation2026.04 | 34.25 |