Legal Judgment Prediction on ILDC (test)
84.52AccuracyFC-Last3-RFN
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FC-Last3-RFNBackbone=Llama-8b, Setting=Refrain2026.06 | 84.52 | 43.44 | 85.25 | 34.14 | 19.91 | |
| Attn-Mid3-RFNBackbone=Mistral-7b, Setting=Refrain2026.06 | 79.15 | 54.38 | 73.06 | 28.13 | 13.82 | |
| Attn-Mid3-RFNBackbone=Llama-8b, Setting=Refrain2026.06 | 78.88 | 51.81 | 76.06 | 27.04 | 19.51 | |
| Attn-Last3-RFNBackbone=Llama-8b, Setting=Refrain2026.06 | 78.73 | 40.6 | 81.17 | 43.05 | 13.12 | |
| FC-Mid3-RFNBackbone=Llama-8b, Setting=Refrain2026.06 | 78.06 | 50.5 | 76.06 | 30.13 | 18.06 | |
| FC-Last3-RFNBackbone=Mistral-7b, Setting=Refrain2026.06 | 77.29 | 54.06 | 71 | 30.3 | 11.45 | |
| FC-Last3-REVBackbone=Qwen-7b, Setting=Reverse2026.06 | 75.74 | 100 | 54.05 | 9.52 | 16.43 | |
| FC-Mid3-RFNBackbone=Mistral-7b, Setting=Refrain2026.06 | 74.87 | 65.59 | 61.61 | 19.11 | 14.19 | |
| FC-Last3-REVBackbone=Llama-8b, Setting=Reverse2026.06 | 74.85 | 100 | 85.25 | 34.14 | 19.91 | |
| Attn-Mid3-REVBackbone=Llama-8b, Setting=Reverse2026.06 | 74.35 | 100 | 76.06 | 27.04 | 19.51 | |
| FC-Last3-RFNBackbone=Qwen-7b, Setting=Refrain2026.06 | 74.17 | 72.38 | 54.05 | 9.52 | 16.43 | |
| Attn-Last3-RFNBackbone=Qwen-7b, Setting=Refrain2026.06 | 73.33 | 68.49 | 55.25 | 15.12 | 13.58 | |
| FC-Mid3-REVBackbone=Mistral-7b, Setting=Reverse2026.06 | 73.15 | 99.14 | 61.61 | 19.11 | 14.19 | |
| FC-Mid3-REVBackbone=Llama-8b, Setting=Reverse2026.06 | 72.85 | 100 | 76.06 | 30.13 | 18.06 | |
| Attn-Last3-REVBackbone=Qwen-7b, Setting=Reverse2026.06 | 72.78 | 100 | 55.25 | 15.12 | 13.58 | |
| Attn-Mid3-REVBackbone=Mistral-7b, Setting=Reverse2026.06 | 72.64 | 99.14 | 73.06 | 28.13 | 13.82 | |
| Attn-Last3-RFNBackbone=Mistral-7b, Setting=Refrain2026.06 | 71.8 | 58.67 | 61.13 | 30.3 | 7.41 | |
| FC-Last3-REVBackbone=Mistral-7b, Setting=Reverse2026.06 | 70.3 | 99.14 | 71 | 30.3 | 11.45 | |
| Attn-Last3-REVBackbone=Llama-8b, Setting=Reverse2026.06 | 68.07 | 100 | 81.17 | 43.05 | 13.12 | |
| Attn-Last3-REVBackbone=Mistral-7b, Setting=Reverse2026.06 | 66.35 | 99.14 | 61.13 | 30.3 | 7.41 | |
| Attn-Mid3-RFNBackbone=Qwen-7b, Setting=Refrain2026.06 | 65.64 | 68.16 | 44.56 | 24.26 | 3.75 | |
| Attn-Mid3-REVBackbone=Qwen-7b, Setting=Reverse2026.06 | 63.16 | 100 | 44.56 | 24.26 | 3.75 | |
| FC-Mid3-RFNBackbone=Qwen-7b, Setting=Refrain2026.06 | 60.17 | 95.72 | 5.58 | 3.33 | 0.33 | |
| FC-Mid3-REVBackbone=Qwen-7b, Setting=Reverse2026.06 | 59.86 | 100 | 5.58 | 3.33 | 0.33 | |
| LLM-onlyBackbone=Qwen-7b2026.06 | 59.2 | 100 | — | — | — | |
| LLM-onlyBackbone=Mistral-7b2026.06 | 58.78 | 99.14 | — | — | — | |
| LLM-onlyBackbone=Llama-8b2026.06 | 54.84 | 100 | — | — | — |