List your company
ResearchFormerly WizWand

Open-domain Question Answering on TriviaQA (EM, F1, tokens)

59.36Exact Match (EM)Oracle
29.387237.168644.9552.7314Sep 3, 2024
Updated 6mo ago

Evaluation results

MethodLinks
OracleRetrieval Strategy=Adaptive Compression, Generator=LLAMA2-7B2024.0959.3626183.98
Top-5 documentsRetrieval Strategy=Retrieval without Compression, Generator=LLAMA2-7B2024.0948.5880880.2
AdaCompRetrieval Strategy=Adaptive Compression, Generator=LLAMA2-7B2024.0947.1546879.4
ONLY_DOCRetrieval Strategy=Retrieval with Compression, Generator=LLAMA2-7B2024.0944.616677.86
Top-1 documentRetrieval Strategy=Retrieval without Compression, Generator=LLAMA2-7B2024.0943.5716077.51
RECOMPRetrieval Strategy=Retrieval with Compression, Generator=LLAMA2-7B2024.0941.777476.17
FILCORetrieval Strategy=Retrieval with Compression, Generator=LLAMA2-7B2024.0938.965874.14
LLAMA2-7BRetrieval Strategy=No Retrieval, Generator=LLAMA2-7B2024.0930.54—68.86