Polarization Detection on SemEval Task 9 Subtask 1 2026 (dev)
80.4POL PerformanceVanilla RemBERT
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Vanilla RemBERTStrategy=mixed, Pooling=Cls2026.06 | 80.4 | 85 | 70.1 | 81 | 77.5 | 69.6 | 77.8 | 90.8 | 79 | 69.3 | 86.7 | |
| RemBERT (cont.)Strategy=mixed, Pooling=Cls2026.06 | 79.8 | 83.7 | 72.8 | 80.3 | 75.7 | 67.2 | 75.8 | 91.2 | 80.4 | 72.3 | 85.2 | |
| LaBSEStrategy=mixed, Pooling=ours2026.06 | 76.8 | 88.6 | 77.1 | 81.9 | 77.8 | 68.5 | 79.8 | 88.1 | 79.9 | 72.7 | 87.8 | |
| LaBSEStrategy=separate, Pooling=ours2026.06 | 75.8 | 85.9 | 79.1 | 78.9 | 76.8 | 65.9 | 75.4 | 88.5 | 77.6 | 68.3 | 87.4 | |
| EuroBERTStrategy=mixed, Pooling=Cls2026.06 | 75 | — | — | — | — | 69.2 | — | — | — | — | — | |
| Qwen-2.5-14bStrategy=7 shots, Pooling=text2026.06 | 73.5 | 72.5 | 69.2 | 76.7 | 57.8 | 62.3 | 69 | 71.3 | 75.8 | 68.9 | 86.4 | |
| Qwen-2.5-14bStrategy=7 shots, Pooling=text+ipa2026.06 | 71.8 | 74.5 | — | — | 65.8 | 67.2 | 72.8 | 73.5 | 74.8 | 71.9 | 85.6 | |
| Qwen-2.5-14bStrategy=0 shots, Pooling=text2026.06 | 71.7 | 73.6 | 68.5 | 57.8 | 63.6 | 64.3 | 56.9 | 57.6 | 75.1 | 65.9 | 79.4 |