Overruling classification on Overruling (test)
0.974Mean F1Custom Legal-BERT
Evaluation results
| Method | Links | |
|---|---|---|
| Custom Legal-BERTNumber of Pretraining Steps=2M, Vocabulary Size (domain)=32,000 (legal)2021.04 | 0.974 | |
| Legal-BERTNumber of Pretraining Steps=2M, Vocabulary Size (domain)=30,522 (general)2021.04 | 0.963 | |
| BERTNumber of Pretraining Steps=1M, Vocabulary Size (domain)=30,522 (general)2021.04 | 0.958 | |
| BERT (double)Number of Pretraining Steps=2M, Vocabulary Size (domain)=30,522 (general)2021.04 | 0.958 | |
| Baseline2021.04 | 0.91 |