List your company
ResearchFormerly WizWand

Question Answering on HotpotQA December 2018 Wikipedia dump (test)

37.23EMDoc-Search
22.846826.580930.31534.0491Dec 17, 2024Mar 14, 2025Jun 10, 2025Sep 6, 2025Dec 2, 2025Feb 28, 2026May 27, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Doc-SearchRetriever=E5-base-v2, Knowledge Base=Wikipedia-182026.0537.23——
EXITReader Model=Llama3.1-70B-Instruct, Compressor Type=Extractive2024.123748.33.3
StepSearchRetriever=E5-base-v2, Knowledge Base=Wikipedia-182026.0536.31——
Search-R1Retriever=E5-base-v2, Knowledge Base=Wikipedia-182026.0536.16——
ReSearchRetriever=E5-base-v2, Knowledge Base=Wikipedia-182026.0534.88——
DeepResearcherRetriever=E5-base-v2, Knowledge Base=Wikipedia-182026.0534.85——
LongLLMLinguaReader Model=Llama3.1-70B-Instruct, Compressor Type=Extractive2024.1234.145.34
CompActReader Model=Llama3.1-70B-Instruct, Compressor Type=Abstractive2024.1233.844.111
RefinerReader Model=Llama3.1-70B-Instruct, Compressor Type=Abstractive2024.1233.844.714.6
Original DocsReader Model=Llama3.1-70B-Instruct, Compressor Type=None2024.1233.744.58.3
R-SearchRetriever=E5-base-v2, Knowledge Base=Wikipedia-182026.0532.59——
ZeroSearchRetriever=E5-base-v2, Knowledge Base=Wikipedia-182026.0532.11——
EXITReader Model=Llama3.1-8B-Instruct, Compressor Type=Extractive2024.1230.641.50.8
RECOMP-AbstReader Model=Llama3.1-70B-Instruct, Compressor Type=Abstractive2024.1230.340.84.4
CompActReader Model=Llama3.1-8B-Instruct, Compressor Type=Abstractive2024.1228.839.88.3
RefinerReader Model=Llama3.1-8B-Instruct, Compressor Type=Abstractive2024.1228.8406.9
Original DocsReader Model=Llama3.1-8B-Instruct, Compressor Type=None2024.1228.138.61
LongLLMLinguaReader Model=Llama3.1-8B-Instruct, Compressor Type=Extractive2024.1228380.8
RECOMP-ExtrReader Model=Llama3.1-70B-Instruct, Compressor Type=Extractive2024.1227.636.72.9
RECOMP-AbstReader Model=Llama3.1-8B-Instruct, Compressor Type=Abstractive2024.1226.5372.2
RECOMP-ExtrReader Model=Llama3.1-8B-Instruct, Compressor Type=Extractive2024.1223.432.80.4