Legal Information Extraction and Entailment on COLIEE
61.1Average ScoreQwen3-30B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen3-30BPost-Training Stage=DPO, Parameters=30B, Training Methodology=KG-assisted Post-Training2026.01 | 61.1 | 40.3 | 62.1 | 67.7 | 74.2 | |
| Llama3.1-70BPost-Training Stage=DPO, Parameters=70B, Training Methodology=KG-assisted Post-Training2026.01 | 60.7 | 32.4 | 67.6 | 64.6 | 78 | |
| Llama3.1-70BPost-Training Stage=SFT, Parameters=70B, Training Methodology=KG-assisted Post-Training2026.01 | 59.8 | 30.6 | 66 | 64.4 | 77.9 | |
| Qwen3-30BPost-Training Stage=SFT, Parameters=30B, Training Methodology=KG-assisted Post-Training2026.01 | 59 | 35 | 60 | 67.1 | 73.9 | |
| Llama3.1-70BPost-Training Stage=OOB, Parameters=70B2026.01 | 57 | 30.8 | 57.7 | 61.3 | 78.4 | |
| Qwen3-30BPost-Training Stage=OOB, Parameters=30B2026.01 | 56.6 | 39.8 | 52.2 | 64.3 | 70.2 | |
| Nemotron1.5-49BPost-Training Stage=DPO, Parameters=49B, Training Methodology=KG-assisted Post-Training2026.01 | 54.2 | 28.5 | 57.2 | 53.4 | 77.7 | |
| Nemotron1.5-49BPost-Training Stage=SFT, Parameters=49B, Training Methodology=KG-assisted Post-Training2026.01 | 53.5 | 28.3 | 54.6 | 53.4 | 77.5 | |
| Nemotron1.5-49BPost-Training Stage=OOB, Parameters=49B2026.01 | 49.4 | 20.3 | 48 | 53.6 | 75.9 | |
| SaulLMParameters=141B2026.01 | 24.6 | 0 | 25.1 | 0 | 73.1 |