Question Answering on All QA Datasets Average
40.66EMSIGHT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SIGHTModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 40.66 | 1.59 | |
| ARPOModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 39.75 | 2.15 | |
| Search-R1Model=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 38.1 | 2.11 | |
| SIGHTModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 37.3 | 1.71 | |
| Tree-GRPOModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 36.93 | 1.67 | |
| ARPOModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 36 | 3.1 | |
| Teacher-3BModel Family=Qwen 2.5, Teacher Model=Qwen 2.5 3B2025.08 | 35.3 | — | |
| DGPOModel Family=Qwen 2.5, Teacher Model=Qwen 2.5 3B, Student Model=Qwen 2.5 0.5B2025.08 | 32.9 | — | |
| Search-R1Model=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 32.37 | 2.18 | |
| Search-o1Model=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 31.25 | 1.2 | |
| KDModel Family=Qwen 2.5, Teacher Model=Qwen 2.5 3B, Student Model=Qwen 2.5 0.5B2025.08 | 29.8 | — | |
| Tree-GRPOModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 29.13 | 1.72 | |
| SFT → PPOModel Family=Qwen 2.5, Teacher Model=Qwen 2.5 3B, Student Model=Qwen 2.5 0.5B2025.08 | 28.9 | — | |
| DistiLLMModel Family=Qwen 2.5, Teacher Model=Qwen 2.5 3B, Student Model=Qwen 2.5 0.5B2025.08 | 28.7 | — | |
| TAIDModel Family=Qwen 2.5, Teacher Model=Qwen 2.5 3B, Student Model=Qwen 2.5 0.5B2025.08 | 28.2 | — | |
| SeqKDModel Family=Qwen 2.5, Teacher Model=Qwen 2.5 3B, Student Model=Qwen 2.5 0.5B2025.08 | 27.5 | — | |
| GRPOModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 26.38 | 0 | |
| Search-o1Model=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 25.15 | 1.02 | |
| GKDModel Family=Qwen 2.5, Teacher Model=Qwen 2.5 3B, Student Model=Qwen 2.5 0.5B2025.08 | 24 | — | |
| PPOModel Family=Qwen 2.5, Teacher Model=Qwen 2.5 3B, Student Model=Qwen 2.5 0.5B2025.08 | 23.8 | — | |
| GRPOModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 21.45 | 0 | |
| ReActModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 19.82 | 1.79 | |
| Vanilla RAGModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 15.22 | 1 | |
| Direct ReasoningModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 10.15 | 0 | |
| COTModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 9.4 | 0 | |
| Vanilla RAGModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 6.53 | 1 | |
| ReActModel=Qwen2.5-3B-Instruct, Retrieval Configuration=w/ Retrieval2026.02 | 2.64 | 2.91 | |
| Student-0.5BModel Family=Qwen 2.5, Student Model=Qwen 2.5 0.5B2025.08 | 0.6 | — | |
| COTModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 0.11 | 0 | |
| Direct ReasoningModel=Qwen2.5-7B-Instruct, Retrieval Configuration=w/o Retrieval2026.02 | 0.08 | 0 |