Dialogue Comprehension on DREAM
69.2AccuracyRoBERTa^ASA
Evaluation Results
| Method | Links | |
|---|---|---|
| RoBERTa^ASABackbone architecture=RoBERTa, ASA=true2022.06 | 69.2 | |
| RoBERTaBackbone architecture=RoBERTa2022.06 | 67 | |
| BERT^ASABackbone architecture=BERT, ASA=true2022.06 | 64.3 | |
| BERT†^ASABackbone architecture=BERT, Pre-training strategy=longer-trained with MLM, ASA=true2022.06 | 63.3 | |
| BERTBackbone architecture=BERT2022.06 | 62.9 | |
| BART-FTtraining_mode=supervised finetuning2022.03 | 62.56 | |
| BERT†Backbone architecture=BERT, Pre-training strategy=longer-trained with MLM2022.06 | 61.2 | |
| Narratorpre-training_data=DIANA, pre-training_task=GEN, training_mode=zero-shot2022.03 | 53.41 | |
| BART-CRD3-GENpre-training_data=CRD3, pre-training_task=GEN, training_mode=zero-shot2022.03 | 52.96 | |
| BART-CNN-GENpre-training_data=CNN, pre-training_task=GEN, training_mode=zero-shot2022.03 | 52.72 | |
| BART-CNN-CLSpre-training_data=CNN, pre-training_task=CLS, training_mode=zero-shot2022.03 | 50.46 | |
| BART-DIAL-DEpre-training_data=DIAL, pre-training_task=DE, training_mode=zero-shot2022.03 | 46.69 | |
| ROBERTatraining_mode=zero-shot2022.03 | 45.22 | |
| BARTtraining_mode=zero-shot2022.03 | 45.07 | |
| GPT-2training_mode=zero-shot2022.03 | 41.99 |