List your company
ResearchFormerly WizWand

Passage Ranking on WebQuestions (WQ)

63.97R@10monot5-3B
51.687654.876358.06561.2537Feb 16, 2024
Updated 8mo ago

Evaluation results

MethodLinks
monot5-3BSupervision=Supervised, LLM=T5-3B2024.0263.97——
EcoRankSupervision=Unsupervised, Budget=B1, Strategy=Hybr, LLM=T5-XL2024.0263.58——
monot5-baseSupervision=Supervised, LLM=T5-base2024.0262.94——
monoBERTSupervision=Supervised, LLM=BERT2024.0262.94——
TARTSupervision=Supervised, LLM=T5-XL2024.0262.64——
InParsSupervision=Unsupervised, Budget=B3, LLM=T5-large2024.0262.25——
LikertSupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=T5-XL2024.0262.05——
InParsSupervision=Unsupervised, Budget=B1, LLM=T5-large2024.0261.95——
BinarySupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=T5-XL2024.0261.76——
InParsSupervision=Unsupervised, Budget=B2, LLM=T5-large2024.0261.66——
LikertSupervision=Unsupervised, Budget=B2, Strategy=Point, LLM=T5-XL2024.0260.92——
B-PRPSupervision=Unsupervised, Budget=B1, Strategy=Pair, LLM=T5-XL2024.0260.53——
EcoRankSupervision=Unsupervised, Budget=B2, Strategy=Hybr, LLM=T5-XL+L2024.0260.33——
BinarySupervision=Unsupervised, Budget=B2, Strategy=Point, LLM=T5-XL2024.0259.64——
LikertSupervision=Unsupervised, Budget=B3, Strategy=Point, LLM=T5-XL2024.0257.77——
BinarySupervision=Unsupervised, Budget=B3, Strategy=Point, LLM=T5-XL2024.0257.08——
B-RankGPTSupervision=Unsupervised, Budget=B1, Strategy=List, LLM=GPT-3.52024.0256.88——
EcoRank-w/o-casc.Supervision=Unsupervised, Budget=B2, Strategy=Hybr, LLM=T5-XL2024.0256.79——
BinarySupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=GPT-3.52024.0256.74——
EcoRankSupervision=Unsupervised, Budget=B3, Strategy=Hybr, LLM=T5-XL+L2024.0256.69——
B-PRPSupervision=Unsupervised, Budget=B2, Strategy=Pair, LLM=T5-XL2024.0255.65——
EcoRank-w/o-casc.Supervision=Unsupervised, Budget=B3, Strategy=Hybr, LLM=T5-XL2024.0255.21——
B-UPRSupervision=Unsupervised, Budget=B3, Strategy=Point, LLM=T5-XL2024.0254.8——
B-PRPSupervision=Unsupervised, Budget=B3, Strategy=Pair, LLM=T5-XL2024.0253.65——
BM25Supervision=None2024.0252.16——
B-UPRSupervision=Unsupervised, Budget=B1, Strategy=Point, LLM=T5-XL2024.0252.16——
B-PRPSupervision=Unsupervised, Budget=B1, Strategy=Pair, LLM=GPT-3.52024.0252.16——
B-UPRSupervision=Unsupervised, Budget=B2, Strategy=Point, LLM=T5-XL2024.0252.16——
BM252024.02—29.6918.89
EcoRankStrategy=Hybr., LLM=T5-XL, Budget=B1 - 0.57 cents2024.02—48.9441.58
EcoRankStrategy=Hybr., LLM=T5-XL+L, Budget=B2 - 0.11 cents2024.02—47.0540.55
EcoRankStrategy=Hybr., LLM=T5-XL+L, Budget=B3 - 0.05 cents2024.02—43.8637
monoBERTLLM=BERT2024.02—43.6333.8
monot5-3BLLM=T5-3B2024.02—44.8835.23
monot5-baseLLM=T5-base2024.02—43.1533.21
TARTLLM=T5-XL2024.02—42.6533.07