Multiple choice question answering on LexGLUE CaseHold (test)
78.6Micro-F1LegalModernBERT-large
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LegalModernBERT-largeModel size=large, Pre-training strategy=domain-adapted (continued pre-training)2026.06 | 78.6 | 78.6 | |
| ModernBERT-largeModel size=large, Pre-training strategy=vanilla2026.06 | 76.9 | 76.9 | |
| LegalModernBERTModel size=base, Pre-training strategy=domain-adapted (continued pre-training)2026.06 | 76.1 | 76.1 | |
| Best Reported in [6]Model size=base2026.06 | 75.4 | 75.4 | |
| LegalModernBERT-large from scratchModel size=large, Pre-training strategy=from scratch2026.06 | 75 | 75 | |
| LegalModernBERT from scratchModel size=base, Pre-training strategy=from scratch2026.06 | 74.9 | 74.9 | |
| ModernBERTModel size=base, Pre-training strategy=vanilla2026.06 | 74.8 | 74.8 | |
| RoBERTa-largeModel size=large2026.06 | 74.4 | 74.4 |