Natural Language Inference on SciTail (dev)
98.2AccuracyALUM_ROBERTA-LARGE-SMART
Evaluation Results
| Method | Links | |
|---|---|---|
| ALUM_ROBERTA-LARGE-SMARTBackbone=RoBERTa-Large, Adversarial Pre-training=ALUM, Adversarial Fine-tuning=SMART2020.04 | 98.2 | |
| ALUM_ROBERTA-LARGEBackbone=RoBERTa-Large, Adversarial Pre-training=ALUM2020.04 | 97.4 | |
| MT-DNN-SMART_LARGE_V0backbone=BERT-Large, architecture=MT-DNN, framework=SMART, version=v02019.11 | 96.6 | |
| MT-DNN_LARGEbackbone=BERT-Large, architecture=MT-DNN2019.11 | 96.3 | |
| MT-DNNModel Architecture=LARGE2019.01 | 96.3 | |
| MT-DNN_LARGEBackbone=MT-DNN-Large2020.04 | 96.3 | |
| SMART_BERT-LARGEbackbone=BERT-Large, framework=SMART2019.11 | 96.2 | |
| MT-DNN-SMART_BASEbackbone=BERT-Base, architecture=MT-DNN, framework=SMART2019.11 | 96.1 | |
| MT-DNN-SMART_BASE_V0backbone=BERT-Base, architecture=MT-DNN, framework=SMART, version=v02019.11 | 96 | |
| MT-DNN_BASEbackbone=BERT-Base, architecture=MT-DNN2019.11 | 95.8 | |
| BERT_LARGEbackbone=BERT-Large2019.11 | 95.7 | |
| MT-DNNModel Architecture=BASE2019.01 | 95.7 | |
| BERTModel Architecture=LARGE2019.01 | 95.7 | |
| BERT_LARGEBackbone=BERT-Large2020.04 | 95.7 | |
| SMART_BERT-BASEbackbone=BERT-Base, framework=SMART2019.11 | 94.8 | |
| BERT_BASEbackbone=BERT-Base2019.11 | 94.3 | |
| BERTModel Architecture=BASE2019.01 | 94.3 |