Answer Sentence Selection on Alexa Virtual Assistant traffic accurate Sample 2 (test)
74.85Prec@1TANDA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TANDABackbone=RoBERTa, Model Size=Large, Transfer Sequence=ASNQ → NAD2019.11 | 74.85 | 62.5 | 82.1 | |
| TANDABackbone=BERT, Model Size=Large, Transfer Sequence=ASNQ → NAD2019.11 | 63.47 | 51.4 | 72.7 | |
| RoBERTaModel Size=Large, Training Strategy=Fine-tuning on NAD2019.11 | 63.47 | 58.1 | 73.4 | |
| TANDABackbone=RoBERTa, Model Size=Base, Transfer Sequence=ASNQ → NAD2019.11 | 62.87 | 53.7 | 71.4 | |
| RoBERTaModel Size=Large, Training Strategy=Zero-shot from ASNQ2019.11 | 59.88 | 52.6 | 70.5 | |
| TANDABackbone=BERT, Model Size=Base, Transfer Sequence=ASNQ → NAD2019.11 | 58.68 | 47.4 | 68.3 | |
| RoBERTaModel Size=Base, Training Strategy=Fine-tuning on NAD2019.11 | 56.29 | 51.1 | 67 | |
| RoBERTaModel Size=Base, Training Strategy=Zero-shot from ASNQ2019.11 | 54.5 | 47.3 | 65.6 | |
| BERTModel Size=Large, Training Strategy=Fine-tuning on NAD2019.11 | 53.29 | 46.9 | 62.9 | |
| BERTModel Size=Base, Training Strategy=Fine-tuning on NAD2019.11 | 52.69 | 43.2 | 62.9 | |
| BERTModel Size=Large, Training Strategy=Zero-shot from ASNQ2019.11 | 50.89 | 44 | 63 | |
| BERTModel Size=Base, Training Strategy=Zero-shot from ASNQ2019.11 | 44.31 | 39.5 | 56.7 |