Answer Sentence Selection on WikiQA
85.6P@1TANDA ELECTRA_Base (ours)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TANDA ELECTRA_Base (ours)backbone=ELECTRA_Base, training=TANDA2023.09 | 85.6 | 90.2 | 91.4 | |
| ROBERTa-Base + SSP (DPC)Context=true2023.05 | 85.2 | 89.9 | — | |
| ROBERTaBase Flexible (REk) + MSPPBackbone=RoBERTa-base, Architecture Type=Flexible, Prediction Head=REk, Pre-training Objective=MSPP2023.09 | 83.5 | 88.7 | 90 | |
| TANDA RoBERTa_Base (ours)backbone=RoBERTa_Base, training=TANDA2023.09 | 83 | 88.5 | 89.9 | |
| ELECTRA-Base + SSP (SDC)Context=true2023.05 | 82.9 | 88.7 | — | |
| RoBERTa_Base + SSPbackbone=RoBERTa_Base, objective=Sentences in the Same Paragraph2023.09 | 82.9 | 88.7 | 89.9 | |
| Joint MSPP IEkArchitecture=Joint model, Pre-training Task=MSPP, Pre-training Head=IEk, Fine-tuning Head=IEk, Protocol=Re-ranking top-52022.05 | 82.7 | — | — | |
| ROBERTaBase Fixed (IEk) + MSPPBackbone=RoBERTa-base, Architecture Type=Fixed, Prediction Head=IEk, Pre-training Objective=MSPP2023.09 | 82.7 | 88.5 | 89 | |
| RoBERTa_Base + ALLbackbone=RoBERTa_Base, objective=SSP + SP + PSD2023.09 | 82.5 | 88.2 | 89.5 | |
| ELECTRA_Base + SSPbackbone=ELECTRA_Base, objective=Sentences in the Same Paragraph2023.09 | 82.5 | 88.6 | 90 | |
| ROBERTa-Base + SSP (All)Context=true2023.05 | 82.4 | 88.2 | — | |
| Joint MSPP AEkArchitecture=Joint model, Pre-training Task=MSPP, Pre-training Head=AEk, Fine-tuning Head=AEk, Protocol=Re-ranking top-52022.05 | 82.1 | — | — | |
| ROBERTaBase Fixed (AEk) + MSPPBackbone=RoBERTa-base, Architecture Type=Fixed, Prediction Head=AEk, Pre-training Objective=MSPP2023.09 | 81.9 | 87.9 | 89 | |
| ROBERTa-Base + SSP (SDC)Context=true2023.05 | 81.8 | 87.8 | — | |
| ELECTRA_Base + SPbackbone=ELECTRA_Base, objective=Sentences in Paragraph2023.09 | 81.8 | 88.1 | 89.5 | |
| ROBERTa-Base + SSP (DSLC)Context=true2023.05 | 81.6 | 87.8 | — | |
| ELECTRA-Base + SSP (All)Context=true2023.05 | 81.5 | 87.5 | — | |
| ELECTRA-Base + SSP (DPC)Context=true2023.05 | 81.3 | 88 | — | |
| RoBERTa_Base + SPbackbone=RoBERTa_Base, objective=Sentences in Paragraph2023.09 | 81 | 87.7 | 88.9 | |
| ELECTRA_Base + ALLbackbone=ELECTRA_Base, objective=SSP + SP + PSD2023.09 | 80.8 | 87.3 | 88.7 | |
| RoBERTa_Base + PSDbackbone=RoBERTa_Base, objective=Paragraphs in the Same Document2023.09 | 80.5 | 86.4 | 88 | |
| ELECTRA-Base + SSP (DSLC)Context=true2023.05 | 79.7 | 87 | — | |
| ELECTRA_Base + PSDbackbone=ELECTRA_Base, objective=Paragraphs in the Same Document2023.09 | 78.6 | 85.6 | 87.3 | |
| ELECTRA-BaseContext=false2023.05 | 78.5 | 85.7 | — | |
| RoBERTa_Basebackbone=RoBERTa_Base2023.09 | 78.3 | 85.8 | 87.2 | |
| ROBERTa-BaseContext=false2023.05 | 77.2 | 85.1 | — | |
| Pairwise RoBERTa-BaseArchitecture=Pairwise Cross-encoder, Protocol=Re-ranking top-52022.05 | 77.1 | — | — | |
| ROBERTaBaseBackbone=RoBERTa-base, Reference=Liu et al., 2019b2023.09 | 77.1 | 85.3 | 86.5 | |
| ELECTRA_Basebackbone=ELECTRA_Base2023.09 | 77.1 | 85 | 86.5 | |
| ROBERTa-BaseContext=true2023.05 | 77 | 84.4 | — | |
| ELECTRA-BaseContext=true2023.05 | 73.8 | 83.1 | — | |
| ROBERTaBase Flexible (REk)Backbone=RoBERTa-base, Architecture Type=Flexible, Prediction Head=REk, Pre-training Objective=Standard2023.09 | 69.5 | 77.8 | 79.6 | |
| Joint RoBERTa-BaseArchitecture=Joint model, Fine-tuning Head=AEk, Protocol=Re-ranking top-52022.05 | 26.4 | — | — | |
| Joint RoBERTa-BaseArchitecture=Joint model, Fine-tuning Head=IEk, Protocol=Re-ranking top-52022.05 | 24.6 | — | — | |
| ROBERTaBase Fixed (IEk)Backbone=RoBERTa-base, Architecture Type=Fixed, Prediction Head=IEk, Pre-training Objective=Standard2023.09 | 19.7 | 39.4 | 40.3 | |
| ROBERTaBase Fixed (AEk)Backbone=RoBERTa-base, Architecture Type=Fixed, Prediction Head=AEk, Pre-training Objective=Standard2023.09 | 18.7 | 39 | 39.7 | |
| CT RoBERTa_Basebackbone=RoBERTa_Base2023.09 | — | 89.9 | 91 | |
| RLAS-BIABC2023.09 | — | 88.8 | 89.1 | |
| TANDA RoBERTa_Basebackbone=RoBERTa_Base, training=TANDA2023.09 | — | 88.9 | 90.1 | |
| TANDA ROBERTaBaseBackbone=RoBERTa-base, Reference=Garg et al., 20192023.09 | — | 88.9 | 90.1 |