Question Answering on WebQ (EM, ROUGE, F1)
32EMGRIP w/o RL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GRIP w/o RLTraining status=Training-based, Backbone=LLaMA3-8B, Retriever=BM252026.04 | 32 | 39.9 | 35.1 | |
| GRIPTraining status=Training-based, Backbone=LLaMA3-8B, Retriever=BM252026.04 | 31.4 | 39.3 | 34.6 | |
| DRAGINTraining status=Training-free2026.04 | 25.2 | 31.5 | 35.7 | |
| FLARETraining status=Training-free2026.04 | 24.2 | 30.3 | 34.7 | |
| GPT-4oTraining status=Training-free2026.04 | 23.5 | 32.3 | 37 | |
| R1-SearcherTraining status=Training-based, Backbone=LLaMA3-8B, Retriever=BM252026.04 | 21.8 | 26.1 | 30.6 | |
| RetRobustTraining status=Training-based, Backbone=LLaMA3-8B, Retriever=BM252026.04 | 21.8 | 27.4 | 31.7 | |
| RobustRAGTraining status=Training-based, Backbone=LLaMA3-8B, Retriever=BM252026.04 | 21.5 | 25 | 29.1 | |
| Robust-RAGBackbone=Qwen2.5-7B-Instruct2026.04 | 21.1 | 25.8 | 30 | |
| Robust-RAGBackbone=Qwen-3-4B-Instruct2026.04 | 19.8 | 24.5 | 28.7 | |
| InstructRAGTraining status=Training-based, Backbone=LLaMA3-8B, Retriever=BM252026.04 | 19.5 | 26.8 | 31.4 | |
| R1-SearcherBackbone=Qwen2.5-7B-Instruct2026.04 | 19.3 | 26.7 | 30.7 | |
| GRIPBackbone=Qwen2.5-7B-Instruct2026.04 | 19.3 | 28.3 | 33.2 | |
| ETCTraining status=Training-free2026.04 | 18.9 | 26.6 | 30.4 | |
| SFT-RAGTraining status=Training-based, Backbone=LLaMA3-8B, Retriever=BM252026.04 | 18.9 | 18.3 | 23.1 | |
| INFO-RAGTraining status=Training-based, Backbone=LLaMA3-8B, Retriever=BM252026.04 | 18.1 | 27.7 | 28.9 | |
| GRIPBackbone=Qwen-3-4B-Instruct2026.04 | 16.8 | 27.5 | 32.3 | |
| GainRAGTraining status=Training-based, Backbone=LLaMA3-8B, Retriever=BM252026.04 | 16.5 | 24.5 | 28.9 | |
| Self-RAGTraining status=Training-based, Backbone=LLaMA3-8B, Retriever=BM252026.04 | 16.4 | 26.5 | 27.4 | |
| GPT-3.5 TurboTraining status=Training-free2026.04 | 15.9 | 27.4 | 31.9 | |
| Single-RAGBackbone=Qwen2.5-7B-Instruct2026.04 | 15.3 | 22.6 | 26.3 | |
| InstructTraining status=Training-free2026.04 | 14.8 | 25.1 | 29.4 | |
| InstructBackbone=Qwen2.5-7B-Instruct2026.04 | 14.5 | 22.6 | 26.4 | |
| Single RAGTraining status=Training-free2026.04 | 14 | 22.7 | 26.6 | |
| R1-SearcherBackbone=Qwen-3-4B-Instruct2026.04 | 12.9 | 21.6 | 25.4 | |
| Single-RAGBackbone=Qwen-3-4B-Instruct2026.04 | 8.7 | 16.7 | 20.2 | |
| InstructBackbone=Qwen-3-4B-Instruct2026.04 | 7.7 | 16.3 | 20 |