Question Answering on HotpotQA (F1 Score)
69.1F1 ScoreLogicGaze
Evaluation results
| Method | Links | |
|---|---|---|
| LogicGazeBackbone=Qwen2.5-7B, Retrieval Status=With Retrieval, Evaluation Protocol=RAG2026.01 | 69.1 | |
| IterDRAGBackbone=Qwen2.5-7B, Retrieval Status=With Retrieval, Evaluation Protocol=RAG2026.01 | 68.3 | |
| RankRAGBackbone=Qwen2.5-7B, Retrieval Status=With Retrieval, Evaluation Protocol=RAG2026.01 | 67.8 | |
| AutoRAGBackbone=Qwen2.5-7B, Retrieval Status=With Retrieval, Evaluation Protocol=RAG2026.01 | 67.6 | |
| RQ-RAGBackbone=Qwen2.5-7B, Retrieval Status=With Retrieval, Evaluation Protocol=RAG2026.01 | 67.3 | |
| Self-RAGBackbone=Qwen2.5-7B, Retrieval Status=With Retrieval, Evaluation Protocol=RAG2026.01 | 64.5 | |
| GPT-4oBackbone=GPT-4o, Retrieval Status=With Retrieval2026.01 | 46.5 | |
| SAIL-7BBackbone=Qwen2.5-7B, Retrieval Status=With Retrieval, Evaluation Protocol=RAG2026.01 | 45.5 | |
| GPT-4o-miniBackbone=GPT-4o-mini, Retrieval Status=With Retrieval2026.01 | 45.4 | |
| SFT+RetBackbone=Qwen2.5-7B, Retrieval Status=With Retrieval, Evaluation Protocol=SFT2026.01 | 44 | |
| SFTBackbone=Qwen2.5-7B, Retrieval Status=Without Retrieval, Evaluation Protocol=SFT2026.01 | 42.5 | |
| Zero-Shot+RetBackbone=Qwen2.5-7B, Retrieval Status=With Retrieval, Evaluation Protocol=Zero-Shot2026.01 | 28.4 | |
| Zero-ShotBackbone=Qwen2.5-7B, Retrieval Status=Without Retrieval, Evaluation Protocol=Zero-Shot2026.01 | 25.2 | |
| Zero-Shot-Chat+RetBackbone=Qwen2.5-7B, Retrieval Status=With Retrieval, Evaluation Protocol=Chat2026.01 | 18.3 | |
| Zero-Shot-ChatBackbone=Qwen2.5-7B, Retrieval Status=Without Retrieval, Evaluation Protocol=Chat2026.01 | 16.4 |