Legal Language Understanding on LexGLUE
67.2LexGLUE AverageLlama3.1-70B
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Llama3.1-70BPost-Training Stage=DPO, Parameters=70B, Training Methodology=KG-assisted Post-Training2026.01 | 67.2 | 77.9 | 82.3 | 31.8 | 67.5 | 68.8 | 75.1 | |
| Llama3.1-70BPost-Training Stage=SFT, Parameters=70B, Training Methodology=KG-assisted Post-Training2026.01 | 66.8 | 77.3 | 82.1 | 32.3 | 66.8 | 68.9 | 73.4 | |
| Llama3.1-70BPost-Training Stage=OOB, Parameters=70B2026.01 | 65 | 73.6 | 80 | 33.9 | 63.6 | 67.5 | 71.6 | |
| SaulLMParameters=141B2026.01 | 64.4 | 73.6 | 77.6 | 32.2 | 71.8 | 52.2 | 79 | |
| Nemotron1.5-49BPost-Training Stage=DPO, Parameters=49B, Training Methodology=KG-assisted Post-Training2026.01 | 62.5 | 66.3 | 73.7 | 29.5 | 67.2 | 65.4 | 73.2 | |
| Qwen3-30BPost-Training Stage=DPO, Parameters=30B, Training Methodology=KG-assisted Post-Training2026.01 | 61.6 | 62.8 | 69 | 30.5 | 69.6 | 65.9 | 72 | |
| Nemotron1.5-49BPost-Training Stage=SFT, Parameters=49B, Training Methodology=KG-assisted Post-Training2026.01 | 61.2 | 63.2 | 70 | 29.2 | 66.5 | 66 | 72.5 | |
| Qwen3-30BPost-Training Stage=SFT, Parameters=30B, Training Methodology=KG-assisted Post-Training2026.01 | 60.3 | 59.7 | 66.3 | 28.5 | 69.6 | 65.8 | 71.7 | |
| Qwen3-30BPost-Training Stage=OOB, Parameters=30B2026.01 | 57.9 | 53.4 | 60.2 | 27.6 | 69.7 | 66 | 70.7 | |
| Nemotron1.5-49BPost-Training Stage=OOB, Parameters=49B2026.01 | 57 | 52.8 | 60.9 | 27.1 | 66 | 65.4 | 69.7 |