List your company
ResearchFormerly WizWand

Open-domain Question Answering on Natural Questions (F1, AR)

52.2F1 ScoreUMGP-RAG
18.420827.190435.9644.7296Jun 11, 2026
Updated 4mo ago

Evaluation results

MethodLinks
UMGP-RAGRetriever=Qwen3-Embedding-4B, Generator=Llama-3.2-3B-Instruct2026.0652.249.84
LongRAGRetriever=Qwen3-Embedding-4B, Generator=Llama-3.2-3B-Instruct2026.0651.4549.49
UMGP-RAGRetriever=BGE-M3, Generator=Llama-3.2-3B-Instruct2026.0651.2848.78
REPLUGRetriever=Qwen3-Embedding-4B, Generator=Llama-3.2-3B-Instruct2026.0651.246.42
LongRAGRetriever=BGE-M3, Generator=Llama-3.2-3B-Instruct2026.0651.1349.1
MS-PoERetriever=Qwen3-Embedding-4B, Generator=Llama-3.2-3B-Instruct2026.0650.4647.2
MS-PoERetriever=BGE-M3, Generator=Llama-3.2-3B-Instruct2026.0650.0547.09
HybridRetriever=BGE-M3, Generator=Llama-3.2-3B-Instruct2026.0649.8647.66
UMG-RAGRetriever=Qwen3-Embedding-4B, Generator=Llama-3.2-3B-Instruct2026.0649.7447.9
REPLUGRetriever=BGE-M3, Generator=Llama-3.2-3B-Instruct2026.0649.6244.59
RAGRetriever=BGE-M3, Generator=Llama-3.2-3B-Instruct2026.0649.4145.93
RAGRetriever=Qwen3-Embedding-4B, Generator=Llama-3.2-3B-Instruct2026.0649.3946.21
RAGRetriever=SPLADEv3, Generator=Llama-3.2-3B-Instruct2026.0649.2347.41
HybridRetriever=Qwen3-Embedding-4B, Generator=Llama-3.2-3B-Instruct2026.0649.1647.41
UMG-RAGRetriever=BGE-M3, Generator=Llama-3.2-3B-Instruct2026.0648.7347.16
UMGP-RAGRetriever=BERT, Generator=Llama-3.2-3B-Instruct2026.0648.1145.33
LongLLMLinguaRetriever=BGE-M3, Generator=Llama-3.2-3B-Instruct2026.0646.3144.62
LongLLMLinguaRetriever=Qwen3-Embedding-4B, Generator=Llama-3.2-3B-Instruct2026.0645.6143.46
UMG-RAGRetriever=BERT, Generator=Llama-3.2-3B-Instruct2026.0645.1443.04
HybridRetriever=BERT, Generator=Llama-3.2-3B-Instruct2026.0645.0442.93
PINERetriever=BGE-M3, Generator=Llama-3.2-3B-Instruct2026.0644.5246.03
PINERetriever=Qwen3-Embedding-4B, Generator=Llama-3.2-3B-Instruct2026.0642.9144.38
Summarized RAGRetriever=Qwen3-Embedding-4B, Generator=Llama-3.2-3B-Instruct2026.0635.3731.62
Summarized RAGRetriever=BGE-M3, Generator=Llama-3.2-3B-Instruct2026.0635.231.27
LongLLMLinguaRetriever=BERT, Generator=Llama-3.2-3B-Instruct2026.0625.7324.29
MS-PoERetriever=BERT, Generator=Llama-3.2-3B-Instruct2026.0624.3521.92
RAGRetriever=BERT, Generator=Llama-3.2-3B-Instruct2026.0624.1421.78
LongRAGRetriever=BERT, Generator=Llama-3.2-3B-Instruct2026.0623.1820.94
REPLUGRetriever=BERT, Generator=Llama-3.2-3B-Instruct2026.0622.5418.96
PINERetriever=BERT, Generator=Llama-3.2-3B-Instruct2026.0620.8420.97
Summarized RAGRetriever=BERT, Generator=Llama-3.2-3B-Instruct2026.0619.7217.03