Legal Classification on SCDB 15 categories (test)
82.4AccuracyModel 4 (Prompt-Based Classification with Log-Smoothed Weighted Loss and Classification Head Adaptation)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Model 4 (Prompt-Based Classification with Log-Smoothed Weighted Loss and Classification Head Adaptation)Technique=PB32025.12 | 82.4 | 82.7 | 82 | |
| Model 2 (LegalBERT)Technique=NPB22025.12 | 79.3 | 79.2 | 79.1 | |
| Model 1 (BERT)Technique=NPB22025.12 | 78.5 | 77.9 | 78 | |
| Model 2 (LegalBERT)Technique=NPB12025.12 | 74.8 | 70.5 | 71.5 | |
| Model 1 (BERT)Technique=NPB12025.12 | 71.8 | 66.9 | 67.9 | |
| Model 3 (Prompt-Based Classification)Technique=PB12025.12 | 55.4 | 63.3 | 57.7 | |
| Model 3 (Prompt-Based Classification)Technique=PB22025.12 | 33.2 | 46.1 | 34.6 |