Rhetorical Role Labeling on SCOTUSCategory (test)
85.03Macro F1Qwen-3-8B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen-3-8BFramework=RISE2026.05 | 85.03 | 86.38 | |
| Mistral-7BFramework=RISE2026.05 | 84.57 | 86.57 | |
| Mistral-7BFramework=Baseline2026.05 | 83.88 | 85.89 | |
| DeBERTa_baseFramework=RISE2026.05 | 83.83 | 86.13 | |
| DeBERTa_baseFramework=Baseline2026.05 | 83.73 | 85.91 | |
| Llama-3-8BFramework=RISE2026.05 | 83.15 | 85.7 | |
| Qwen-3-8BFramework=Baseline2026.05 | 82.85 | 84.95 | |
| RoBERTa_baseFramework=RISE2026.05 | 82.83 | 85.76 | |
| Llama-3-8BFramework=Baseline2026.05 | 82.54 | 85.13 | |
| BERT_baseFramework=RISE2026.05 | 82.19 | 85.12 | |
| RoBERTa_baseFramework=Baseline2026.05 | 82.13 | 84.99 | |
| ALBERT_baseFramework=RISE2026.05 | 81.81 | 84.21 | |
| BERT_baseFramework=Baseline2026.05 | 81.7 | 84.46 | |
| ALBERT_baseFramework=Baseline2026.05 | 81.59 | 84.25 |