List your company
ResearchFormerly WizWand

RAG Question Answering on NQ (Natural Questions) (F1)

54.06F1 ScoreIndexLM-1.7B
23.74431.614539.48547.3555Dec 7, 2025
Updated 8mo ago

Evaluation results

MethodLinks
IndexLM-1.7Banswer model=Gemma3-27B-it, Avg. Tokens=20432025.1254.06
IndexLM-4Banswer model=Gemma3-27B-it, Avg. Tokens=19282025.1253.1
IndexLM-4Banswer model=Qwen3-4B, Avg. Tokens=19282025.1252.77
IndexLM-0.6Banswer model=Gemma3-27B-it, Avg. Tokens=19662025.1252.59
IndexLM-0.6Banswer model=Qwen3-4B, Avg. Tokens=19662025.1251.51
IndexLM-1.7Banswer model=Qwen3-4B, Avg. Tokens=20432025.1251.42
Chunk-Rerankanswer model=Gemma3-27B-it, Avg. Tokens=40942025.1249.65
Qwen3-4B + promptanswer model=Gemma3-27B-it, Avg. Tokens=25632025.1248.02
Firecrawl Extractanswer model=Gemma3-27B-it, Avg. Tokens=13192025.1247.95
Firecrawl Extractanswer model=Qwen3-4B, Avg. Tokens=13192025.1247.94
HtmlRAGanswer model=Gemma3-27B-it, Avg. Tokens=35622025.1246.99
Qwen3-4B + promptanswer model=Qwen3-4B, Avg. Tokens=25632025.1245.23
Chunk-Rerankanswer model=Qwen3-4B, Avg. Tokens=40942025.1244.39
ReaderLM-v2answer model=Qwen3-4B, Avg. Tokens=40002025.1244.35
ReaderLM-v2answer model=Gemma3-27B-it, Avg. Tokens=40002025.1243.81
HtmlRAGanswer model=Qwen3-4B, Avg. Tokens=35622025.1242.56
Markdown (raw)answer model=Gemma3-27B-it, Avg. Tokens=40962025.1240.42
Markdown (raw)answer model=Qwen3-4B, Avg. Tokens=40962025.1237.74
HTML (raw)answer model=Qwen3-4B, Avg. Tokens=40962025.1226.32
HTML (raw)answer model=Gemma3-27B-it, Avg. Tokens=40962025.1224.91