Semantic Role Classification on FrameNet 1.7 (test)
89.9AccuracyAn et al. (2023)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| An et al. (2023)2026.04 | 89.9 | — | — | |
| RoBERTa SEPInput style=SEP, Evaluation protocol=fine-tuned2026.04 | 86.1 | 86.6 | 64.8 | |
| RoBERTa MASKInput style=MASK, Evaluation protocol=fine-tuned2026.04 | 80.6 | 80.6 | 5.3 | |
| Claude Sonnet 4.0Evaluation protocol=zero-shot2026.04 | 73.6 | 73.6 | 60 | |
| analogical transferFrame id.=gold, Arg id.=Swayamdipta et al., SR cl.=Ours2026.03 | 59.35 | — | — | |
| Swayamdipta et al.Frame id.=gold, Arg id.=Swayamdipta et al., SR cl.=Swayamdipta et al.2026.03 | 58.46 | — | — | |
| Gemini 2.5Evaluation protocol=zero-shot2026.04 | 50.8 | 50.8 | 43 | |
| Devasier et al. (2024)2026.04 | — | 88.7 | — |