Open-domain Question Answering on WebQuestions (test)
59.15Accuracygemma-2-9b-it
Evaluation results
| Method | Links | ||
|---|---|---|---|
| gemma-2-9b-itRetrieval Type=Evidence, N=152025.06 | 59.15 | — | |
| gemma-2-9b-itRetrieval Type=Combined, N=152025.06 | 58.26 | — | |
| Llama-3.1-8B-InstructRetrieval Type=Evidence, N=152025.06 | 58.21 | — | |
| Llama-3.1-8B-InstructRetrieval Type=Combined, N=152025.06 | 58.12 | — | |
| Qwen2.5-7B-InstructRetrieval Type=Evidence, N=152025.06 | 57.6 | — | |
| gemma-2-9b-itRetrieval Type=Graph, N=152025.06 | 56.22 | — | |
| Qwen2.5-7B-InstructRetrieval Type=Combined, N=152025.06 | 56.21 | — | |
| Llama-3.1-8B-InstructRetrieval Type=Graph, N=152025.06 | 55.83 | — | |
| Qwen2.5-7B-InstructRetrieval Type=Graph, N=152025.06 | 54.79 | — | |
| Qwen2.5-3B-InstructRetrieval Type=Combined, N=152025.06 | 53.82 | — | |
| Phi-3.5-mini-instructRetrieval Type=Evidence, N=152025.06 | 53.77 | — | |
| Llama-3.2-3B-InstructRetrieval Type=Combined, N=152025.06 | 53.55 | — | |
| Llama-3.2-3B-InstructRetrieval Type=Evidence, N=152025.06 | 53.2 | — | |
| Phi-3.5-mini-instructRetrieval Type=Combined, N=152025.06 | 53.1 | — | |
| Qwen2.5-3B-InstructRetrieval Type=Evidence, N=152025.06 | 52.98 | — | |
| gemma-2-2b-itRetrieval Type=Evidence, N=152025.06 | 52.1 | — | |
| gemma-2-2b-itRetrieval Type=Combined, N=152025.06 | 51.72 | — | |
| INFO-RAGBackbone=LLaMA-2-13B-chat, Zero-shot=true2024.02 | 51.07 | 46.55 | |
| Phi-3.5-mini-instructRetrieval Type=Graph, N=152025.06 | 50.72 | — | |
| Qwen2.5-3B-InstructRetrieval Type=Graph, N=152025.06 | 50.16 | — | |
| gemma-2-2b-itRetrieval Type=Graph, N=152025.06 | 49.69 | — | |
| INFO-RAGBackbone=LLaMA-2-7B-chat, Zero-shot=true2024.02 | 49.13 | 43.78 | |
| Llama-3.2-3B-InstructRetrieval Type=Graph, N=152025.06 | 49.12 | — | |
| LLaMA-2-7B-chatZero-shot=true2024.02 | 46.72 | 40.83 | |
| gemma-2-9b-itRetrieval Type=None2025.06 | 45.71 | — | |
| LLaMA-2-13B-chatZero-shot=true2024.02 | 45.47 | 43.23 | |
| INFO-RAGBackbone=LLaMA-2-13B, Zero-shot=true2024.02 | 45.42 | 41.04 | |
| INFO-RAGBackbone=LLaMA-2-7B, Zero-shot=true2024.02 | 44.68 | 39.83 | |
| LLaMA-2-13BZero-shot=true2024.02 | 44.62 | 36.86 | |
| LLaMA-2-7BZero-shot=true2024.02 | 43.52 | 35.78 | |
| Llama-3.1-8B-InstructRetrieval Type=None2025.06 | 42.81 | — | |
| Qwen2.5-7B-InstructRetrieval Type=None2025.06 | 38.24 | — | |
| Phi-3.5-mini-instructRetrieval Type=None2025.06 | 35.23 | — | |
| Qwen2.5-3B-InstructRetrieval Type=None2025.06 | 31.61 | — | |
| Llama-3.2-3B-InstructRetrieval Type=None2025.06 | 28.17 | — | |
| gemma-2-2b-itRetrieval Type=None2025.06 | 24.51 | — |