Answer Sentence Selection on WQA (test)
4.96P@1MASR-FP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MASR-FPBackbone=RoBERTa Base, k=32021.07 | 4.96 | 0.94 | 2.43 | |
| MASRBackbone=RoBERTa Base, k=32021.07 | 3.82 | 0.7 | 1.67 | |
| ASRBackbone=RoBERTa Base, k=32021.07 | 2.86 | 0.86 | 1.39 | |
| Joint Model PairwiseBackbone=RoBERTa Base, k=32021.07 | 2.67 | 0.39 | 1.39 | |
| MASR-FBackbone=RoBERTa Base, k=32021.07 | 2.67 | 0.55 | 1.47 | |
| KGATBackbone=RoBERTa Base, k=22021.07 | 2.1 | 0.39 | 0.93 | |
| TANDA ELECTRABase Model=ELECTRA-Base, Intermediate transfer step=ASNQ2022.05 | 1.9 | 1.6 | 1.5 | |
| ELECTRA + PSDBase Model=ELECTRA-Base, Pre-training objective=PSD2022.05 | 1.6 | 1.6 | 1.3 | |
| ELECTRA + AllBase Model=ELECTRA-Base, Pre-training objective=SSP+SP+PSD2022.05 | 1.5 | 1.6 | 1.4 | |
| ELECTRA + SSPBase Model=ELECTRA-Base, Pre-training objective=SSP2022.05 | 1.4 | 1.5 | 1.3 | |
| ELECTRA + SPBase Model=ELECTRA-Base, Pre-training objective=SP2022.05 | 1.4 | 1.5 | 1.3 | |
| ELECTRA-BaseBase Model=ELECTRA-Base2022.05 | 1 | 1.2 | 0.9 | |
| RoBERTa + AllBase Model=RoBERTa-Base, Pre-training objective=SSP+SP+PSD2022.05 | 0.5 | 0.8 | 0.6 | |
| TANDA RoBERTaBase Model=RoBERTa-Base, Intermediate transfer step=ASNQ2022.05 | 0.5 | 0.5 | 0.5 | |
| RoBERTa + SPBase Model=RoBERTa-Base, Pre-training objective=SP2022.05 | 0.4 | 0.7 | 0.5 | |
| RoBERTa + PSDBase Model=RoBERTa-Base, Pre-training objective=PSD2022.05 | 0.4 | 0.7 | 0.5 | |
| RoBERTa + SSPBase Model=RoBERTa-Base, Pre-training objective=SSP2022.05 | 0.2 | 0.6 | 0.3 | |
| Our RerankerBackbone=RoBERTa Base2021.07 | 0 | 0 | 0 | |
| Joint Model Multi-classifierBackbone=RoBERTa Base, k=52021.07 | -2.29 | -1 | -1.23 |