Document Reranking on GOV2 Description
33.54MAPCEDR-KNRM (Max)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CEDR-KNRM (Max)Backbone=ELECTRA, Aggregation strategy=Max-pooling2020.08 | 33.54 | 66.48 | 60.86 | |
| PARADE-CNNBackbone=ELECTRA, Aggregation strategy=CNN, Evaluation protocol=Fine-tuned2020.08 | 33.08 | 66.88 | 61.69 | |
| BirchBackbone=BERT, Evaluation protocol=Fine-tuned2020.08 | 32.7 | 63.12 | 57.63 | |
| ELECTRA-KNRMBackbone=ELECTRA, Kernel size=112020.08 | 32.69 | 64.66 | 58.64 | |
| PARADE-TransformerBackbone=ELECTRA, Aggregation strategy=Transformer, Evaluation protocol=Fine-tuned2020.08 | 32.69 | 66.21 | 60.69 | |
| PARADE-MaxBackbone=ELECTRA, Aggregation strategy=Max, Evaluation protocol=Fine-tuned2020.08 | 31.6 | 62.75 | 57.32 | |
| PARADE-AttnBackbone=ELECTRA, Aggregation strategy=Attention, Evaluation protocol=Fine-tuned2020.08 | 31.16 | 65.84 | 59.9 | |
| PARADE-SumBackbone=ELECTRA, Aggregation strategy=Sum, Evaluation protocol=Fine-tuned2020.08 | 30.75 | 64.36 | 58.79 | |
| PARADE-AvgBackbone=ELECTRA, Aggregation strategy=Average, Evaluation protocol=Fine-tuned2020.08 | 29.24 | 62.28 | 57.1 | |
| ELECTRA-MaxPBackbone=ELECTRA, Pre-training dataset=MSMARCO, Evaluation protocol=Fine-tuned2020.08 | 28.57 | 58.72 | 53.19 | |
| BM25+RM3Model Type=Query Expansion2020.08 | 27.02 | 49.93 | 42.19 | |
| BM25Model Type=Unsupervised2020.08 | 24.07 | 47.05 | 42.64 |