Strategy Question Answering on StrategyQA (Accuracy, Token Usage, Latency)
85.4AccuracyDySCo
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DySCon=6, k=2, R=32026.06 | 85.4 | 3.8 | 9.8 | |
| Dense MADn=6, k=2, R=32026.06 | 83.5 | 12.4 | 18.6 | |
| Trust-Only Sparsen=6, k=2, R=32026.06 | 83.1 | 3.6 | 9.6 | |
| Static Ringn=6, k=2, R=32026.06 | 82 | 3.6 | 9.4 | |
| Random-kn=6, k=2, R=32026.06 | 81.8 | 3.6 | 9.5 | |
| Self-Consistencyn=6, k=2, R=32026.06 | 80.2 | 1.9 | 4.5 | |
| Single-Agent CoTn=6, k=2, R=32026.06 | 75.6 | 0.3 | 3.2 |