Multi-Hop Question Answering on Multi-Hop QA Average
0.3775EMSIGHT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SIGHTModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.3775 | 1.95 | |
| ARPOModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.3626 | 2.31 | |
| Search-R1Model=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.3494 | 2.49 | |
| SIGHTModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.3344 | 2.07 | |
| ARPOModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.3204 | 3.2 | |
| Tree-GRPOModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.3143 | 1.98 | |
| Search-o1Model=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.2945 | 1.51 | |
| Search-R1Model=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.2837 | 2.58 | |
| GRPOModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 0.239 | 0 | |
| Tree-GRPOModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.2379 | 1.95 | |
| Search-o1Model=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.2102 | 1.07 | |
| GRPOModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 0.1927 | 0 | |
| ReActModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.1809 | 2.04 | |
| Vanilla RAGModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.0882 | 1 | |
| Direct ReasoningModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 0.076 | 0 | |
| COTModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 0.0634 | 0 | |
| Vanilla RAGModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.0464 | 1 | |
| ReActModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 0.0237 | 3.32 | |
| Direct ReasoningModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 0.001 | 0 | |
| COTModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 0.0005 | 0 |