List your company
ResearchFormerly WizWand

Passage Retrieval on Natural Questions (NQ)

66.59Top-10 Accuracymonot5-3B
47.724452.622257.5262.4178Feb 16, 2024
Updated 8mo ago

Evaluation results

MethodLinks
monot5-3BSupervision=Supervised, LLM=T5-3B2024.0266.59——
EcoRankSupervision=Unsupervised, Budget=B1, Strategy=Hybr, LLM=T5-XL2024.0265.45——
monoBERTSupervision=Supervised, LLM=BERT2024.0265.18——
monot5-baseSupervision=Supervised, LLM=T5-base2024.0264.65——
TARTSupervision=Supervised, LLM=T5-XL2024.0264.37——
BinarySupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=T5-XL2024.0264.37——
B-PRPSupervision=Unsupervised, Budget=B1, Strategy=Pair, LLM=T5-XL2024.0263.71——
InParsSupervision=Unsupervised, Budget=B2, LLM=T5-large2024.0263.51——
InParsSupervision=Unsupervised, Budget=B3, LLM=T5-large2024.0263.24——
LikertSupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=T5-XL2024.0263.07——
EcoRankSupervision=Unsupervised, Budget=B2, Strategy=Hybr, LLM=T5-XL+L2024.0262.46——
InParsSupervision=Unsupervised, Budget=B1, LLM=T5-large2024.0262.4——
LikertSupervision=Unsupervised, Budget=B2, Strategy=Point, LLM=T5-XL2024.0261.57——
BinarySupervision=Unsupervised, Budget=B2, Strategy=Point, LLM=T5-XL2024.0260.72——
LikertSupervision=Unsupervised, Budget=B3, Strategy=Point, LLM=T5-XL2024.0259.11——
B-RankGPTSupervision=Unsupervised, Budget=B1, Strategy=List, LLM=GPT-3.52024.0258.33——
EcoRank-w/o-casc.Supervision=Unsupervised, Budget=B2, Strategy=Hybr, LLM=T5-XL2024.0258.31——
BinarySupervision=Unsupervised, Budget=B3, Strategy=Point, LLM=T5-XL2024.0258.31——
BinarySupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=GPT-3.52024.0258.19——
B-PRPSupervision=Unsupervised, Budget=B2, Strategy=Pair, LLM=T5-XL2024.0257.72——
EcoRankSupervision=Unsupervised, Budget=B3, Strategy=Hybr, LLM=T5-XL+L2024.0257.72——
EcoRank-w/o-casc.Supervision=Unsupervised, Budget=B3, Strategy=Hybr, LLM=T5-XL2024.0256.28——
BM25Supervision=None2024.0254.45——
B-PRPSupervision=Unsupervised, Budget=B3, Strategy=Pair, LLM=T5-XL2024.0254.45——
B-UPRSupervision=Unsupervised, Budget=B3, Strategy=Point, LLM=T5-XL2024.0253.51——
B-PRPSupervision=Unsupervised, Budget=B1, Strategy=Pair, LLM=GPT-3.52024.0252——
B-UPRSupervision=Unsupervised, Budget=B2, Strategy=Point, LLM=T5-XL2024.0249.55——
B-UPRSupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=T5-XL2024.0248.45——
ANCETraining Setting=Single Task2020.07—81.987.5
ANCETraining Setting=Multi Task2020.07—82.187.9
BM25Training Setting=Single Task2020.07—59.173.7
BM25+DPRTraining Setting=Single Task2020.07—76.683.8
BM25+DPRTraining Setting=Multi Task2020.07—7883.9
DPRTraining Setting=Single Task2020.07—78.485.4
DPRTraining Setting=Multi Task2020.07—79.486