Text Classification on SST-2 (macro-F1)
93.4macro-F1ForumBERT
Evaluation results
| Method | Links | |
|---|---|---|
| ForumBERTPre-training tokens=0.6B2020.10 | 93.4 | |
| BERTPre-training tokens=3.3B2020.10 | 92.4 | |
| TwitterBERTPre-training tokens=0.9B2020.10 | 92.3 | |
| SciBERTPre-training tokens=3.1B2020.10 | 91.4 | |
| BioBERTPre-training tokens=18B2020.10 | 91.1 | |
| ClinicalBERTPre-training tokens=0.5B2020.10 | 90.4 |