Aspect Category Opinion Sentiment Quad Prediction on Lap-ACOS (test)
44.6F1 ScoreACOS-Contra
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ACOS-Contra2023.10 | 44.6 | — | — | |
| ACOS-Base2023.10 | 43.1 | — | — | |
| PARAPHRASE2023.10 | 42.9 | — | — | |
| ChatGPT2023.10 | 23.7 | — | — | |
| Adjudication (Adj)Model Scale=Med2026.01 | 18.99 | 18.31 | 19.72 | |
| Adjudication (Adj)Model Scale=Mini2026.01 | 16.43 | 16.71 | 16.17 | |
| Annotator A1Model Scale=Med2026.01 | 15.75 | 15.77 | 15.74 | |
| Annotator A1Model Scale=Mini2026.01 | 13.07 | 13.18 | 12.97 | |
| Annotator A2Model Scale=Mini2026.01 | 12.12 | 11.65 | 12.63 | |
| Adjudication (Adj)Model Scale=Small2026.01 | 11.01 | 10.94 | 11.07 | |
| Annotator A2Model Scale=Med2026.01 | 9.78 | 9.63 | 9.94 | |
| Annotator A1Model Scale=Small2026.01 | 9.69 | 9.78 | 9.6 | |
| Annotator A2Model Scale=Small2026.01 | 7.66 | 7.62 | 7.69 | |
| Annotator A3Model Scale=Med2026.01 | 7.66 | 7.62 | 7.69 | |
| Annotator A3Model Scale=Small2026.01 | 6.7 | 6.92 | 6.49 | |
| Annotator A3Model Scale=Mini2026.01 | 1.58 | 1.36 | 1.9 |