Document Type Classification on Docs
91.2F1 ScoreQwen-base
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen-basePre-training=base2026.06 | 91.2 | |
| Qwen3-0.6B-PTPre-training=PT2026.06 | 90.7 | |
| moBERTo-SWM-8k (PT tok.)Tokenizer=PT tok., Context Length=8k2026.06 | 90.39 | |
| NeoBERT-PTPre-training=PT2026.06 | 90.3 | |
| moBERTo-SWM (PT tok.)Tokenizer=PT tok.2026.06 | 90.24 | |
| BERTimbau-basePre-training=base2026.06 | 89.78 | |
| NeoBERT-basePre-training=base2026.06 | 89.7 | |
| moBERTo-8k (orig. tok.)Tokenizer=orig. tok., Context Length=8k2026.06 | 89.62 | |
| moBERTo (orig. tok.)Tokenizer=orig. tok.2026.06 | 89.42 | |
| BERT-basePre-training=base2026.06 | 87 | |
| ModernBERT-basePre-training=base2026.06 | 84.16 |