Legal Judgment Prediction on ECHR (test)
82.15AccuracyFC-Last3-RFN
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FC-Last3-RFNBackbone=Mistral-7b, Setting=Refrain2026.06 | 82.15 | 52.85 | 74.66 | 30.04 | 10.69 | |
| Attn-Last3-RFNBackbone=Mistral-7b, Setting=Refrain2026.06 | 81.5 | 48.78 | 76.55 | 35.27 | 8.18 | |
| FC-Mid3-RFNBackbone=Mistral-7b, Setting=Refrain2026.06 | 81.16 | 50.63 | 75.09 | 33.13 | 8.85 | |
| FC-Mid3-RFNBackbone=Llama-8b, Setting=Refrain2026.06 | 79.39 | 45.83 | 78.59 | 33.24 | 17.02 | |
| Attn-Mid3-RFNBackbone=Mistral-7b, Setting=Refrain2026.06 | 78.06 | 60.37 | 65.78 | 23.13 | 11.39 | |
| Attn-Last3-RFNBackbone=Qwen-7b, Setting=Refrain2026.06 | 75.33 | 60.87 | 64.75 | 21.12 | 15.31 | |
| Attn-Last3-REVBackbone=Llama-8b, Setting=Reverse2026.06 | 75.14 | 98.36 | 63.09 | 16.23 | 19.53 | |
| Attn-Last3-RFNBackbone=Llama-8b, Setting=Refrain2026.06 | 74.26 | 61.94 | 63.09 | 16.23 | 19.53 | |
| FC-Mid3-RFNBackbone=Qwen-7b, Setting=Refrain2026.06 | 74.16 | 33.69 | 79.1 | 57.17 | 0.47 | |
| Attn-Mid3-REVBackbone=Mistral-7b, Setting=Reverse2026.06 | 73.07 | 99.9 | 65.78 | 23.13 | 11.39 | |
| Attn-Last3-REVBackbone=Qwen-7b, Setting=Reverse2026.06 | 73.05 | 100 | 64.75 | 21.12 | 15.31 | |
| FC-Last3-REVBackbone=Mistral-7b, Setting=Reverse2026.06 | 72.26 | 99.9 | 74.66 | 30.04 | 10.69 | |
| FC-Mid3-REVBackbone=Llama-8b, Setting=Reverse2026.06 | 71.63 | 98.36 | 78.59 | 33.24 | 17.02 | |
| FC-Last3-RFNBackbone=Llama-8b, Setting=Refrain2026.06 | 71.4 | 55.95 | 63.77 | 26.3 | 14.04 | |
| Attn-Mid3-RFNBackbone=Llama-8b, Setting=Refrain2026.06 | 71.4 | 55.95 | 63.77 | 26.3 | 14.04 | |
| FC-Mid3-REVBackbone=Mistral-7b, Setting=Reverse2026.06 | 70.14 | 99.9 | 75.09 | 33.13 | 8.85 | |
| Attn-Last3-REVBackbone=Mistral-7b, Setting=Reverse2026.06 | 69.44 | 99.9 | 76.55 | 35.27 | 8.18 | |
| FC-Last3-REVBackbone=Llama-8b, Setting=Reverse2026.06 | 69.2 | 98.36 | 63.77 | 26.3 | 14.04 | |
| Attn-Mid3-REVBackbone=Llama-8b, Setting=Reverse2026.06 | 69.2 | 98.36 | 63.77 | 26.3 | 14.04 | |
| FC-Last3-RFNBackbone=Qwen-7b, Setting=Refrain2026.06 | 66.16 | 70.15 | 43.4 | 20.05 | 6.84 | |
| Attn-Mid3-RFNBackbone=Qwen-7b, Setting=Refrain2026.06 | 65.67 | 70.15 | 43.4 | 20.12 | 6.85 | |
| FC-Last3-REVBackbone=Qwen-7b, Setting=Reverse2026.06 | 65.23 | 100 | 43.4 | 20.05 | 6.84 | |
| Attn-Mid3-REVBackbone=Qwen-7b, Setting=Reverse2026.06 | 65.16 | 100 | 43.4 | 20.12 | 6.85 | |
| LLM-onlyBackbone=Mistral-7b2026.06 | 61.27 | 99.9 | — | — | — | |
| FC-Mid3-REVBackbone=Qwen-7b, Setting=Reverse2026.06 | 58.2 | 100 | 79.1 | 57.17 | 0.47 | |
| LLM-onlyBackbone=Llama-8b2026.06 | 55.17 | 98.36 | — | — | — | |
| LLM-onlyBackbone=Qwen-7b2026.06 | 54.14 | 100 | — | — | — |