Acceptability Classification on CoLA out-of-domain (dev test)
84.9AccuracyEn-ROBERTa
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| En-ROBERTatraining_mode=Fine-tuned LMs2023.04 | 84.9 | 0.637 | |
| En-ROBERTa + TDAtraining_mode=Fine-tuned LMs2023.04 | 83.5 | 0.62 | |
| En-ROBERTa + TDAexttraining_mode=Fine-tuned LMs2023.04 | 83.1 | 0.604 | |
| En-BERT + TDAEvaluation Protocol=Fine-tuned2022.05 | 82.1 | 0.565 | |
| En-BERTtraining_mode=Fine-tuned LMs2023.04 | 82 | 0.561 | |
| En-BERT + TDAtraining_mode=Fine-tuned LMs2023.04 | 81.4 | 0.548 | |
| En-BERT + HOMEvaluation Protocol=Fine-tuned2022.05 | 81.2 | 0.542 | |
| En-BERTEvaluation Protocol=Fine-tuned2022.05 | 81 | 0.536 | |
| En-BERT + TDAexttraining_mode=Fine-tuned LMs2023.04 | 81 | 0.556 | |
| XLM-R + TDAEvaluation Protocol=Fine-tuned2022.05 | 80.4 | 0.522 | |
| XLM-REvaluation Protocol=Fine-tuned2022.05 | 79.3 | 0.489 | |
| En-ROBERTa + TDAtraining_mode=Frozen LMs2023.04 | 78.5 | 0.464 | |
| XLM-R + HOMEvaluation Protocol=Fine-tuned2022.05 | 77.7 | 0.445 | |
| En-ROBERTa + TDAexttraining_mode=Frozen LMs2023.04 | 77.3 | 0.476 | |
| En-BERT + TDAEvaluation Protocol=Frozen2022.05 | 76.7 | 0.42 | |
| En-BERT + HOMEvaluation Protocol=Frozen2022.05 | 75.2 | 0.372 | |
| En-ROBERTatraining_mode=Frozen LMs2023.04 | 75 | 0.362 | |
| En-BERT + TDAexttraining_mode=Frozen LMs2023.04 | 73.1 | 0.369 | |
| XLM-R + TDAEvaluation Protocol=Frozen2022.05 | 70.3 | 0.297 | |
| XLM-R + HOMEvaluation Protocol=Frozen2022.05 | 69.8 | 0.187 | |
| En-BERTEvaluation Protocol=Frozen2022.05 | 69 | 0.082 | |
| XLM-REvaluation Protocol=Frozen2022.05 | 68.6 | 0.072 | |
| En-BERT + TDAtraining_mode=Frozen LMs2023.04 | 68.4 | 0.335 | |
| En-BERTtraining_mode=Frozen LMs2023.04 | 64.3 | 0.124 |