Whataboutism detection on YouTube (TQ+T)
72Precision (W)BERT
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BERTModel Type=Transfer learning baseline, Mode=Fine-tuning2024.02 | 72 | 36 | 48 | 92 | 98 | 95 | |
| MINABackbone=SBERT, Context size=1, Encoder layers=2, Attention heads=322024.02 | 63 | 53 | 58 | 94 | 96 | 95 | |
| MINABackbone=ROBERTA Irony, Context size=1, Encoder layers=2, Attention heads=322024.02 | 57 | 47 | 52 | 94 | 95 | 94 | |
| C&SModel Type=Conventional measure of semantic similarity2024.02 | 45 | 45 | 45 | 91 | 91 | 91 | |
| ROBERTA IronyModel Type=Transfer learning baseline, Mode=Fine-tuning2024.02 | 30 | 30 | 30 | 93 | 99 | 96 | |
| SimCSEModel Type=Conventional measure of semantic similarity2024.02 | 27 | 68 | 38 | 94 | 72 | 82 | |
| ROBERTAModel Type=Transfer learning baseline, Mode=Fine-tuning2024.02 | 23 | 71 | 34 | 94 | 64 | 76 | |
| SBERTModel Type=Conventional measure of semantic similarity2024.02 | 13 | 5 | 7 | 96 | 99 | 97 |