Rumour Detection on RumourEval
70.2AccuracyBERT
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| BERTevidence-enhanced=true2024.10 | 70.2 | — | — | — | |
| BERTevidence-enhanced=false2024.10 | 68.6 | — | — | — | |
| DEBERTAevidence-enhanced=false2024.10 | 66.6 | — | — | — | |
| DEBERTAevidence-enhanced=true2024.10 | 65.9 | — | — | — | |
| HYPHENevidence-enhanced=true2024.10 | 65.5 | — | — | — | |
| GETevidence-enhanced=true2024.10 | 65 | — | — | — | |
| DEFENDevidence-enhanced=true2024.10 | 60.3 | — | — | — | |
| MISTRALevidence-enhanced=true2024.10 | 41.5 | — | — | — | |
| CHATGPTprompting-style=Vanilla (VAN)2024.10 | 40.5 | — | — | — | |
| MISTRALprompting-style=Vanilla (VaN)2024.10 | 34.9 | — | — | — | |
| CHATGPTevidence-enhanced=true2024.10 | 31.4 | — | — | — | |
| BERTbaseline_type=Generic neural2022.09 | — | 55.6 | 53.3 | 53.3 | |
| dEFENDbaseline_type=Generic neural2022.09 | — | 63.1 | 55.5 | 57.3 | |
| HANbaseline_type=Generic neural2022.09 | — | 65.5 | 44.4 | 51.8 | |
| Hyphen-euclideanmanifold=Euclidean2022.09 | — | 74.6 | 68.6 | 69.7 | |
| Hyphen-hyperbolicmanifold=Hyperbolic2022.09 | — | 72.1 | 71.8 | 71.2 | |
| RoBERTabaseline_type=Generic neural2022.09 | — | 60.2 | 60.2 | 59.5 | |
| SOTA-1baseline_type=Data-specific2022.09 | — | 54.5 | 67.6 | 59.8 | |
| SOTA-2baseline_type=Data-specific2022.09 | — | 58.3 | 77.7 | 66.7 | |
| SOTA-3baseline_type=Data-specific2022.09 | — | 57.1 | 88.8 | 69.5 |