Document Reranking on GOV2 Title
36.28MAPPARADE-Transformer
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PARADE-TransformerBackbone=ELECTRA, Aggregation strategy=Transformer, Evaluation protocol=Fine-tuned2020.08 | 36.28 | 66.51 | 60.93 | |
| PARADE-CNNBackbone=ELECTRA, Aggregation strategy=CNN, Evaluation protocol=Fine-tuned2020.08 | 35.55 | 65.3 | 60.45 | |
| CEDR-KNRM (Max)Backbone=ELECTRA, Aggregation strategy=Max-pooling2020.08 | 34.81 | 63.32 | 57.73 | |
| ELECTRA-KNRMBackbone=ELECTRA, Kernel size=112020.08 | 34.69 | 63.42 | 57.5 | |
| BirchBackbone=BERT, Evaluation protocol=Fine-tuned2020.08 | 34.06 | 61.54 | 55.2 | |
| PARADE-MaxBackbone=ELECTRA, Aggregation strategy=Max, Evaluation protocol=Fine-tuned2020.08 | 33.52 | 62.28 | 56.36 | |
| BM25+RM3Model Type=Query Expansion2020.08 | 33.5 | 56.34 | 48.51 | |
| PARADE-AttnBackbone=ELECTRA, Aggregation strategy=Attention, Evaluation protocol=Fine-tuned2020.08 | 33.06 | 63.59 | 58.64 | |
| PARADE-SumBackbone=ELECTRA, Aggregation strategy=Sum, Evaluation protocol=Fine-tuned2020.08 | 32.68 | 62.18 | 57.47 | |
| ELECTRA-MaxPBackbone=ELECTRA, Pre-training dataset=MSMARCO, Evaluation protocol=Fine-tuned2020.08 | 31.93 | 58.02 | 52.65 | |
| PARADE-AvgBackbone=ELECTRA, Aggregation strategy=Average, Evaluation protocol=Fine-tuned2020.08 | 31.74 | 62.25 | 57.41 | |
| BM25Model Type=Unsupervised2020.08 | 30.56 | 53.62 | 47.74 |