List your company
ResearchFormerly WizWand

Acceptability Classification on CoLA out-of-domain (dev test)

84.9AccuracyEn-ROBERTa
63.47669.03874.680.162May 19, 2022Jul 11, 2022Sep 2, 2022Oct 26, 2022Dec 18, 2022Feb 9, 2023Apr 4, 2023
Updated 8mo ago

Evaluation results

MethodLinks
En-ROBERTatraining_mode=Fine-tuned LMs2023.0484.90.637
En-ROBERTa + TDAtraining_mode=Fine-tuned LMs2023.0483.50.62
En-ROBERTa + TDAexttraining_mode=Fine-tuned LMs2023.0483.10.604
En-BERT + TDAEvaluation Protocol=Fine-tuned2022.0582.10.565
En-BERTtraining_mode=Fine-tuned LMs2023.04820.561
En-BERT + TDAtraining_mode=Fine-tuned LMs2023.0481.40.548
En-BERT + HOMEvaluation Protocol=Fine-tuned2022.0581.20.542
En-BERTEvaluation Protocol=Fine-tuned2022.05810.536
En-BERT + TDAexttraining_mode=Fine-tuned LMs2023.04810.556
XLM-R + TDAEvaluation Protocol=Fine-tuned2022.0580.40.522
XLM-REvaluation Protocol=Fine-tuned2022.0579.30.489
En-ROBERTa + TDAtraining_mode=Frozen LMs2023.0478.50.464
XLM-R + HOMEvaluation Protocol=Fine-tuned2022.0577.70.445
En-ROBERTa + TDAexttraining_mode=Frozen LMs2023.0477.30.476
En-BERT + TDAEvaluation Protocol=Frozen2022.0576.70.42
En-BERT + HOMEvaluation Protocol=Frozen2022.0575.20.372
En-ROBERTatraining_mode=Frozen LMs2023.04750.362
En-BERT + TDAexttraining_mode=Frozen LMs2023.0473.10.369
XLM-R + TDAEvaluation Protocol=Frozen2022.0570.30.297
XLM-R + HOMEvaluation Protocol=Frozen2022.0569.80.187
En-BERTEvaluation Protocol=Frozen2022.05690.082
XLM-REvaluation Protocol=Frozen2022.0568.60.072
En-BERT + TDAtraining_mode=Frozen LMs2023.0468.40.335
En-BERTtraining_mode=Frozen LMs2023.0464.30.124