List your company
ResearchFormerly WizWand

Document Reranking on Robust04 Description

0.4084MAPPARADE-Transformer
0.217560.2671050.316650.366195Aug 20, 2020
Updated 8mo ago

Evaluation results

MethodLinks
PARADE-TransformerBackbone=ELECTRA, Aggregation strategy=Transformer, Evaluation protocol=Fine-tuned2020.080.40840.52550.6127
ELECTRA-KNRMBackbone=ELECTRA, Kernel size=112020.080.40660.52550.6113
T5-3BEvaluation protocol=Zero-shot2020.080.4062—0.6122
BirchBackbone=BERT, Evaluation protocol=Fine-tuned2020.080.40090.5120.5931
PARADE-CNNBackbone=ELECTRA, Aggregation strategy=CNN, Evaluation protocol=Fine-tuned2020.080.40050.52490.6102
PARADE-MaxBackbone=ELECTRA, Aggregation strategy=Max, Evaluation protocol=Fine-tuned2020.080.39920.52170.6022
CEDR-KNRM (Max)Backbone=ELECTRA, Aggregation strategy=Max-pooling2020.080.39750.52190.6044
PARADE-AttnBackbone=ELECTRA, Aggregation strategy=Attention, Evaluation protocol=Fine-tuned2020.080.37970.50680.5871
PARADE-SumBackbone=ELECTRA, Aggregation strategy=Sum, Evaluation protocol=Fine-tuned2020.080.37890.510.5878
PARADE-AvgBackbone=ELECTRA, Aggregation strategy=Average, Evaluation protocol=Fine-tuned2020.080.3640.48960.5642
ELECTRA-MaxPBackbone=ELECTRA, Pre-training dataset=MSMARCO, Evaluation protocol=Fine-tuned2020.080.34640.47310.554
BM25+RM3Model Type=Query Expansion2020.080.28750.36590.4307
BM25Model Type=Unsupervised2020.080.22490.33450.4058