Natural Language Understanding on ExtraGLUE Portuguese (test)
90STS-B Spearman CorrelationXLM-RoBERTa
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| XLM-RoBERTaModel Size=large2026.06 | 90 | 90.27 | 90.14 | 82.31 | 57.75 | 90.44 | 93.31 | 84.01 | |
| BERTimbauModel Size=large2026.06 | 89.4 | 89.61 | 89.5 | 75.45 | 59.15 | 88.24 | 91.55 | 82.23 | |
| PortBERTModel Size=large2026.06 | 88.53 | 88.68 | 88.6 | 72.56 | 61.97 | 89.46 | 92.39 | 82.26 | |
| EuroBERTParameters=610m2026.06 | 88.46 | 88.59 | 88.52 | 78.34 | 59.15 | 91.91 | 94.2 | 83.44 | |
| BERTimbauModel Size=base2026.06 | 88.39 | 88.6 | 88.5 | 70.4 | 56.34 | 87.25 | 90.97 | 80.32 | |
| PortBERTModel Size=base2026.06 | 87.39 | 87.65 | 87.52 | 68.95 | 60.56 | 87.75 | 91.13 | 80.57 | |
| RoBERTaCrawlPTModel Size=base2026.06 | 87.34 | 87.45 | 87.39 | 72.56 | 56.34 | 87.99 | 91.2 | 80.48 | |
| RoBERTaLexPTModel Size=base2026.06 | 86.68 | 86.86 | 86.77 | 69.31 | 59.15 | 89.46 | 92.34 | 80.63 | |
| EuroBERTParameters=210m2026.06 | 86.54 | 86.62 | 86.58 | 65.7 | 57.75 | 87.25 | 91 | 79.14 | |
| AlBERTina 100MVariant=PTPT2026.06 | 86.52 | 86.51 | 86.52 | 70.04 | 56.34 | 85.05 | 89.57 | 79.01 | |
| AlBERTina 100MVariant=PTBR2026.06 | 85.97 | 85.99 | 85.98 | 68.59 | 56.34 | 85.78 | 89.82 | 78.75 | |
| XLM-RoBERTaModel Size=base2026.06 | 85.75 | 86.09 | 85.92 | 68.23 | 60.56 | 87.75 | 91.32 | 79.95 | |
| AiBERTa2026.06 | 83.56 | 83.73 | 83.65 | 64.98 | 56.34 | 82.11 | 86.99 | 76.29 | |
| roBERTa PT2026.06 | 48.06 | 48.51 | 48.29 | 56.68 | 59.15 | 72.06 | 81.79 | 61.04 |