Legal Judgment Prediction on CAIL 2018
42.9Public Safety AccuracyLegalGraphRAG
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| LegalGraphRAGSize=8B-Inst2026.05 | 42.9 | 54.3 | 38.5 | 53.6 | 37.6 | 51.1 | 37.2 | 58.3 | |
| Legal ∆Size=7B-Inst2026.05 | 40.8 | 50.6 | 25.1 | 37.4 | 32.1 | 43.7 | 34.1 | 53.6 | |
| DISC-LawLLM-7BSize=7B-Inst2026.05 | 40.1 | 50.9 | 31 | 51.5 | 34.8 | 47.7 | 34.5 | 56 | |
| ADAPTSize=7B-Inst2026.05 | 38.7 | 43.7 | 32.7 | 43.4 | 27.6 | 41.7 | 35.2 | 50.7 | |
| RAPTORSize=8B-Inst2026.05 | 34.6 | 50.4 | 31.6 | 43.9 | 32.1 | 45.6 | 32.4 | 45.7 | |
| HippoRAG2Size=8B-Inst2026.05 | 34.5 | 38.2 | 24 | 33.5 | 28.8 | 35 | 31 | 36.3 | |
| G-retrieverSize=8B-Inst2026.05 | 33.8 | 48 | 26 | 39.8 | 23.8 | 39.3 | 32.6 | 50.1 | |
| Qwen-3-8BSize=8B-Inst2026.05 | 31.7 | 49.2 | 25.8 | 42.7 | 26.3 | 39.8 | 27.6 | 47.8 | |
| DeepSeek-V3.1Size=∼200B2026.05 | 31 | 51.3 | 29 | 48.4 | 29.8 | 50.2 | 35.2 | 54.8 | |
| Naive RAGSize=8B-Inst2026.05 | 31 | 45.7 | 24.4 | 38.7 | 28.1 | 38.4 | 34.5 | 46.8 | |
| Internlm3-8b-instructSize=8B-Inst2026.05 | 29.8 | 49.1 | 26.7 | 42 | 25.2 | 34.3 | 28.1 | 47.3 | |
| Qwen-2.5-7B-InstructSize=7B-Inst2026.05 | 24 | 45.8 | 23.1 | 42.5 | 22.9 | 36.7 | 27.4 | 46 | |
| LightRAGSize=8B-Inst2026.05 | 20.4 | 43.6 | 21.7 | 42.5 | 19 | 42.5 | 26.9 | 50.6 | |
| GPT-4o-miniSize=∼8B2026.05 | 19.7 | 35.5 | 19.6 | 33.3 | 15.5 | 35.2 | 29 | 46.3 | |
| Glm-4-9b-chatSize=9B-Inst2026.05 | 18.4 | 33.7 | 19.7 | 36.1 | 15.8 | 32.1 | 26 | 44.5 |