Rhetorical Role Labeling on SCOTUS RF
81.11Weighted F1 ScoreGold Prototypes
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gold PrototypesEvaluation protocol=optimal prototype post-hoc for each sentence2026.03 | 81.11 | — | 68.86 | |
| PBRmethod_type=Prototype-Based2026.03 | 80.92 | 67.45 | — | |
| PCMSampling strategy=Supervised Sampling2026.03 | 80.92 | — | 67.45 | |
| PCMSampling strategy=Random Sampling2026.03 | 80.66 | — | 67.24 | |
| PCMSampling strategy=Full Sampling2026.03 | 80.64 | — | 67.53 | |
| PCMmethod_type=Prototype-Based2026.03 | 80.31 | 65.75 | — | |
| PBR2026.03 | 80.31 | — | 65.75 | |
| Mind2026.03 | 79.07 | — | 62.67 | |
| Baseline (HSLN)2026.03 | 78.81 | — | 61.36 | |
| Mistral-7Badaptation_method=QLoRA2026.03 | 76.61 | 70.29 | — | |
| Qwen3-8Badaptation_method=QLoRA2026.03 | 75.53 | 69.36 | — | |
| DeepSeek-70Badaptation_method=QLoRA2026.03 | 75.2 | 65.2 | — | |
| Meta-Llama3-8Badaptation_method=QLoRA2026.03 | 75.09 | 66.78 | — |