Multi-hop QA on MuSiQue (Violation Metrics)
0.83Avg ViolationSAVER
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SAVERModel Scale=LLaMA-3.1-8B2026.04 | 0.83 | 69.38 | 0.11 | 19.73 | |
| MADModel Scale=LLaMA-3.1-8B2026.04 | 2.16 | 26.17 | — | 36.51 | |
| CoTModel Scale=LLaMA-3.1-8B2026.04 | 2.91 | 13.26 | — | 37.58 | |
| VANILLA LMModel Scale=LLaMA-3.1-8B2026.04 | 3.25 | 5.34 | — | 62.63 |