Multi-hop Question Answering on HotpotQA (F1)
76.4F1 ScoreAdaptOrch
Evaluation results
| Method | Links | |
|---|---|---|
| AdaptOrchLat.=1.3×, Tok(K)=22.72026.02 | 76.4 | |
| Self-MoA (matched)Lat.=1.2×, Tok(K)=23.12026.02 | 75.5 | |
| Static-ParallelLat.=1.2×, Tok(K)=28.42026.02 | 72.8 | |
| MoA-3LLat.=2.5×, Tok(K)=47.32026.02 | 71.6 | |
| LLM-BlenderLat.=1.5×, Tok(K)=34.82026.02 | 70.4 | |
| Static-SequentialLat.=2.1×, Tok(K)=26.12026.02 | 69.1 | |
| Single BestLat.=1.0×, Tok(K)=6.82026.02 | 68.3 |