List your company
ResearchFormerly WizWand

RAG Question Answering on HotpotQA

47.67F1 ScoreFirecrawl Extract
18.08225.763533.44541.1265Dec 7, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Firecrawl Extractanswer model=Gemma3-27B-it, Avg. Tokens=13192025.1247.67
IndexLM-0.6Banswer model=Gemma3-27B-it, Avg. Tokens=19662025.1247.63
IndexLM-4Banswer model=Gemma3-27B-it, Avg. Tokens=19282025.1246.83
IndexLM-1.7Banswer model=Gemma3-27B-it, Avg. Tokens=20432025.1245.87
Firecrawl Extractanswer model=Qwen3-4B, Avg. Tokens=13192025.1245.42
Qwen3-4B + promptanswer model=Gemma3-27B-it, Avg. Tokens=25632025.1243.68
IndexLM-4Banswer model=Qwen3-4B, Avg. Tokens=19282025.1241.56
IndexLM-1.7Banswer model=Qwen3-4B, Avg. Tokens=20432025.1241.43
HtmlRAGanswer model=Gemma3-27B-it, Avg. Tokens=35622025.1240.87
IndexLM-0.6Banswer model=Qwen3-4B, Avg. Tokens=19662025.1240.37
Qwen3-4B + promptanswer model=Qwen3-4B, Avg. Tokens=25632025.1239.23
Chunk-Rerankanswer model=Gemma3-27B-it, Avg. Tokens=40942025.1238.39
Markdown (raw)answer model=Gemma3-27B-it, Avg. Tokens=40962025.1236.21
Chunk-Rerankanswer model=Qwen3-4B, Avg. Tokens=40942025.1233.96
HtmlRAGanswer model=Qwen3-4B, Avg. Tokens=35622025.1232.82
ReaderLM-v2answer model=Gemma3-27B-it, Avg. Tokens=40002025.1230.59
Markdown (raw)answer model=Qwen3-4B, Avg. Tokens=40962025.1229.82
ReaderLM-v2answer model=Qwen3-4B, Avg. Tokens=40002025.1226.99
HTML (raw)answer model=Gemma3-27B-it, Avg. Tokens=40962025.1222.01
HTML (raw)answer model=Qwen3-4B, Avg. Tokens=40962025.1219.22