Reasoning Evaluation on Full task set (n=45)
8.84Overall ScoreSingle Agent
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Single AgentN=452026.03 | 8.84 | 9.42 | 9 | 9 | |
| Simple VotingN=452026.03 | 8.78 | 8.66 | 8.67 | 9.44 | |
| Self-ConsistencyN=452026.03 | 8.65 | 8.37 | 8.53 | 9.32 | |
| DCIN=452026.03 | 8.24 | 8.84 | 8.62 | 8.96 | |
| Unstructured DebateN=452026.03 | 7.75 | 8.39 | 7.72 | 8.76 |