Educational Content Classification on Educ.
64.28F1 ScoreNeoBERT-PT
Evaluation results
| Method | Links | |
|---|---|---|
| NeoBERT-PTPre-training=PT2026.06 | 64.28 | |
| moBERTo-SWM-8k (PT tok.)Tokenizer=PT tok., Context Length=8k2026.06 | 63.94 | |
| BERTimbau-basePre-training=base2026.06 | 63.82 | |
| Qwen3-0.6B-PTPre-training=PT2026.06 | 63.11 | |
| Qwen-basePre-training=base2026.06 | 62.89 | |
| moBERTo-SWM (PT tok.)Tokenizer=PT tok.2026.06 | 62.81 | |
| NeoBERT-basePre-training=base2026.06 | 62.66 | |
| moBERTo (orig. tok.)Tokenizer=orig. tok.2026.06 | 60.7 | |
| moBERTo-8k (orig. tok.)Tokenizer=orig. tok., Context Length=8k2026.06 | 60.35 | |
| ModernBERT-basePre-training=base2026.06 | 57.3 | |
| BERT-basePre-training=base2026.06 | 56.9 |