List your company
ResearchFormerly WizWand

Open-domain Question Answering on TriviaQA (TQA)

0.4177AccuracyUR-RAG
0.0083560.1146280.22090.327172Jan 27, 2026Feb 4, 2026Feb 12, 2026Feb 20, 2026Feb 28, 2026Mar 8, 2026Mar 16, 2026
Updated 8mo ago

Evaluation results

MethodLinks
UR-RAGLLM=Qwen-14B, Rank-By=Utility, Retrieval Model=Contriever2026.010.41770.4203
RePlugLLM=Qwen-14B, Rank-By=Utility, Retrieval Model=Contriever2026.010.4010.4077
LURE-RAG (w/o topics)LLM=Qwen-14B, Rank-By=Utility, Retrieval Model=Contriever2026.010.4010.4017
LURE-RAGLLM=Qwen-14B, Rank-By=Utility, Retrieval Model=Contriever2026.010.39940.4039
Gemma3 1BParameter Count=1B, Evaluation Protocol=5-shot2026.030.398—
k-shotLLM=Qwen-14B, Rank-By=Relevance, Retrieval Model=Contriever2026.010.39660.3954
UR-RAGLLM=phi-3.8B, Rank-By=Utility, Retrieval Model=Contriever2026.010.36990.3497
LURE-RAGLLM=phi-3.8B, Rank-By=Utility, Retrieval Model=Contriever2026.010.36350.3304
LURE-RAG (w/o topics)LLM=phi-3.8B, Rank-By=Utility, Retrieval Model=Contriever2026.010.36280.322
MobileLLM-Flash 1.4BParameter Count=1.4B, Evaluation Protocol=5-shot2026.030.3606—
RePlugLLM=phi-3.8B, Rank-By=Utility, Retrieval Model=Contriever2026.010.35820.34
0-shotLLM=Qwen-14B, Rank-By=Relevance, Retrieval Model=Contriever2026.010.35660.3587
k-shotLLM=phi-3.8B, Rank-By=Relevance, Retrieval Model=Contriever2026.010.35090.3137
LFM2 1.2BParameter Count=1.2B, Evaluation Protocol=5-shot2026.030.335—
UR-RAGLLM=llama-1B, Rank-By=Utility, Retrieval Model=Contriever2026.010.31840.3098
RePlugLLM=llama-1B, Rank-By=Utility, Retrieval Model=Contriever2026.010.31110.3042
LURE-RAGLLM=llama-1B, Rank-By=Utility, Retrieval Model=Contriever2026.010.30590.2951
LURE-RAG (w/o topics)LLM=llama-1B, Rank-By=Utility, Retrieval Model=Contriever2026.010.29940.2897
k-shotLLM=llama-1B, Rank-By=Relevance, Retrieval Model=Contriever2026.010.28340.262
0-shotLLM=phi-3.8B, Rank-By=Relevance, Retrieval Model=Contriever2026.010.27790.2214
MobileLLM-Flash 650MParameter Count=650M, Evaluation Protocol=5-shot2026.030.2449—
Llama3.2 1BParameter Count=1B, Evaluation Protocol=5-shot2026.030.2381—
0-shotLLM=llama-1B, Rank-By=Relevance, Retrieval Model=Contriever2026.010.22580.2137
LFM2 700MParameter Count=700M, Evaluation Protocol=5-shot2026.030.225—
MobileLLM-Flash 350MParameter Count=350M, Evaluation Protocol=5-shot2026.030.1984—
Gemma3 270MParameter Count=270M, Evaluation Protocol=5-shot2026.030.154—
LFM2 350MParameter Count=350M, Evaluation Protocol=5-shot2026.030.1497—
Qwen3 0.6BParameter Count=0.6B, Evaluation Protocol=5-shot2026.030.0241—