Legal Sentencing Prediction on CJO22
44.29AccuracyMSR2-Qwen3-8B
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| MSR2-Qwen3-8BMethod Category=Fine-tuning2026.02 | 44.29 | 37.43 | 30.73 | 28.07 | |
| Qwen3-8B-FTMethod Category=Fine-tuning2026.02 | 37.63 | 36.45 | 21.85 | 19.87 | |
| Qwen3-235B-A22B-DIMethod Category=Direct Inference, Evaluation Protocol=Zero-shot2026.02 | 37.28 | 34.81 | 26.35 | 27.29 | |
| RobertaMethod Category=Classification Methods2026.02 | 35.34 | 23.11 | 20.24 | 19.27 | |
| CNNMethod Category=Classification Methods2026.02 | 34.28 | 15.34 | 16.47 | 13.79 | |
| LADANMethod Category=Classification Methods2026.02 | 33.69 | 26.4 | 22.94 | 24.55 | |
| BERTMethod Category=Classification Methods2026.02 | 33.57 | 19.86 | 17.88 | 16.47 | |
| TFIDF+SVMMethod Category=Classification Methods2026.02 | 33.16 | 23.17 | 19.7 | 20.01 | |
| Llama3-8B-FTMethod Category=Fine-tuning2026.02 | 31.68 | 32.05 | 19.48 | 17.26 | |
| Qwen3-14B-RAGMethod Category=Retrieval-augmented Generation2026.02 | 30.57 | 27.07 | 24.05 | 23.81 | |
| Qwen3-32B-DRMethod Category=Direct Reasoning2026.02 | 30.09 | 26.2 | 27.96 | 24.53 | |
| Qwen3-8B-RAGMethod Category=Retrieval-augmented Generation2026.02 | 29.03 | 22.75 | 24.26 | 20.95 | |
| Qwen3-32B-DIMethod Category=Direct Inference, Evaluation Protocol=Zero-shot2026.02 | 28.45 | 27.82 | 22.67 | 22.06 | |
| PLJP-GPT-4o-miniMethod Category=Retrieval-augmented Generation2026.02 | 27.92 | 24.88 | 20.9 | 18.63 | |
| Qwen3-14B-DIMethod Category=Direct Inference, Evaluation Protocol=Zero-shot2026.02 | 27.8 | 24.18 | 26.51 | 22.42 | |
| Qwen3-14B-DRMethod Category=Direct Reasoning2026.02 | 27.8 | 24.18 | 26.51 | 22.42 | |
| TopJudgeMethod Category=Classification Methods2026.02 | 27.14 | 19.76 | 17.69 | 17.94 | |
| NeurJudgeMethod Category=Classification Methods2026.02 | 26.8 | 26.81 | 26.85 | 25.97 | |
| Qwen3-8B-DRMethod Category=Direct Reasoning2026.02 | 22.67 | 22.91 | 22.87 | 18.87 | |
| Qwen3-8B-DIMethod Category=Direct Inference, Evaluation Protocol=Zero-shot2026.02 | 15.14 | 35.81 | 15.4 | 11.28 | |
| Llama3-8B-DIMethod Category=Direct Inference, Evaluation Protocol=Zero-shot2026.02 | 12.96 | 16.63 | 12.45 | 8.69 |