ResearchBenchmarksLinguistic Acceptability on CoLA (dev)Linguistic Acceptability on CoLA (dev)Follow68.5Matthews CorrelationUNIMO12.8627.30541.7556.195Dec 31, 2020Evaluation resultsMethodMethodLinksMatthews CorrelationUNIMOSize=largeSize=large2020.1268.5RoBERTaSize=largeSize=large2020.1268UNIMOSize=baseSize=base2020.1265.4RoBERTaSize=baseSize=base2020.1263.6XLNetSize=largeSize=large2020.1263.6UniLMSize=largeSize=large2020.1261.1BERTSize=largeSize=large2020.1260.6UNIMO (w/o single-modal)Size=base, Note=Removi...Size=base, Note=Removing single-modal learning process2020.1215