MickeyProbe on MickeyCorpus
90.03MickeyProbe English ScoreXLM-RoBERTa Large
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| XLM-RoBERTa LargeModel Architecture=XLM-RoBERTa, Model Scale=Large2021.06 | 90.03 | 61.98 | 53.42 | 63.68 | 59.47 | 63.12 | 50.03 | 47.01 | 45.3 | 55.93 | 43.98 | 57.63 | |
| XLM-RoBERTa BaseModel Architecture=XLM-RoBERTa, Model Scale=Base2021.06 | 89.69 | 58.94 | 53.45 | 60.88 | 49.12 | 59.99 | 45.74 | 45.26 | 41.65 | 51.02 | 40.73 | 54.22 | |
| mBERTModel Architecture=Multilingual BERT2021.06 | 63.56 | 35.58 | 29.13 | 44.7 | 42.58 | 35.15 | 28.3 | 36.03 | 24.04 | 28.15 | 27.85 | 35.92 | |
| d-mBERTModel Architecture=Distilled Multilingual BERT2021.06 | 62.95 | 34.56 | 25.26 | 34.85 | 50.46 | 32.39 | 21.49 | 29.14 | 19.77 | 32.57 | 25.88 | 33.57 | |
| XLM-100Model Architecture=XLM (100 languages)2021.06 | 60.57 | 36.33 | 26.49 | 43.39 | 32.53 | 36.24 | 32.9 | 39.71 | 25.79 | 33.01 | 31.49 | 36.22 | |
| ShortestDescription=Heuristic baseline picking the shortest candidate sequence2021.06 | 23.17 | 27.21 | 29.93 | 31 | 35.84 | 31.68 | 18.55 | 22.01 | 15.46 | 25.07 | 20.66 | 25.51 |