Natural Language Understanding on FLUE 1.0 (test)
95.47CLS-books AccuracyCamembert
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CamembertArchitecture Scale=LARGE2020.10 | 95.47 | 95.37 | 96 | 91.83 | 85.33 | |
| FlaubertArchitecture Scale=LARGE2020.10 | 95 | 94.1 | 95.85 | 89.34 | 83.4 | |
| mBARThezArchitecture Scale=LARGE2020.10 | 94.63 | 94.03 | 95.3 | 90.9 | 81.87 | |
| BARThezArchitecture Scale=BASE2020.10 | 94.47 | 93.17 | 94.97 | 88.9 | 80.73 | |
| mBARTArchitecture Scale=LARGE2020.10 | 93.4 | 93.1 | 93.13 | 89.7 | 81.07 | |
| CamemBERTArchitecture Scale=BASE2020.10 | 92.3 | 93 | 94.85 | 90.14 | 81.2 | |
| FlauBERTArchitecture Scale=BASE2020.10 | 92.3 | 92.45 | 94.1 | 89.49 | 80.6 | |
| mBERTArchitecture Scale=BASE2020.10 | 86.15 | 89.9 | 86.65 | 89.3 | 76.9 | |
| BART-randomArchitecture Scale=BASE2020.10 | 76.37 | 73.2 | 76 | 55.27 | 60.43 |