Multi-hop Question Answering on 2WikiMultihopQA 6 (test)
68p-hatSPECHOP
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SPECHOPTarget Tool (T)=Web Search, Speculator (S)=GPT-4o2026.05 | 68 | 19 | 10 | 50 | 60 | |
| SPECHOPTarget Tool (T)=Web Search, Speculator (S)=GPT-4o mini2026.05 | 41 | 16 | 10 | 68 | 76 | |
| SPECHOPTarget Tool (T)=Web Search, Speculator (S)=Llama 3.1 8B2026.05 | 28 | 3 | 10 | 75 | 78 | |
| SPECHOPTarget Tool (T)=E5 Retrieval, Speculator (S)=Llama 3.1 8B2026.05 | 27 | 30 | 74 | 89 | 91 | |
| SPECHOPTarget Tool (T)=Web Search, Speculator (S)=Qwen 3 8B2026.05 | 18 | 5 | 10 | 85 | 88 | |
| SPECHOPTarget Tool (T)=E5 Retrieval, Speculator (S)=Qwen 3 8B2026.05 | 15 | 35 | 74 | 95 | 95 |