Document Reranking on Robust04 Description
0.4084MAPPARADE-Transformer
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PARADE-TransformerBackbone=ELECTRA, Aggregation strategy=Transformer, Evaluation protocol=Fine-tuned2020.08 | 0.4084 | 0.5255 | 0.6127 | |
| ELECTRA-KNRMBackbone=ELECTRA, Kernel size=112020.08 | 0.4066 | 0.5255 | 0.6113 | |
| T5-3BEvaluation protocol=Zero-shot2020.08 | 0.4062 | — | 0.6122 | |
| BirchBackbone=BERT, Evaluation protocol=Fine-tuned2020.08 | 0.4009 | 0.512 | 0.5931 | |
| PARADE-CNNBackbone=ELECTRA, Aggregation strategy=CNN, Evaluation protocol=Fine-tuned2020.08 | 0.4005 | 0.5249 | 0.6102 | |
| PARADE-MaxBackbone=ELECTRA, Aggregation strategy=Max, Evaluation protocol=Fine-tuned2020.08 | 0.3992 | 0.5217 | 0.6022 | |
| CEDR-KNRM (Max)Backbone=ELECTRA, Aggregation strategy=Max-pooling2020.08 | 0.3975 | 0.5219 | 0.6044 | |
| PARADE-AttnBackbone=ELECTRA, Aggregation strategy=Attention, Evaluation protocol=Fine-tuned2020.08 | 0.3797 | 0.5068 | 0.5871 | |
| PARADE-SumBackbone=ELECTRA, Aggregation strategy=Sum, Evaluation protocol=Fine-tuned2020.08 | 0.3789 | 0.51 | 0.5878 | |
| PARADE-AvgBackbone=ELECTRA, Aggregation strategy=Average, Evaluation protocol=Fine-tuned2020.08 | 0.364 | 0.4896 | 0.5642 | |
| ELECTRA-MaxPBackbone=ELECTRA, Pre-training dataset=MSMARCO, Evaluation protocol=Fine-tuned2020.08 | 0.3464 | 0.4731 | 0.554 | |
| BM25+RM3Model Type=Query Expansion2020.08 | 0.2875 | 0.3659 | 0.4307 | |
| BM25Model Type=Unsupervised2020.08 | 0.2249 | 0.3345 | 0.4058 |