Stance Detection on RumorEval S (PH)
84.2Micro F1JSDRV
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| JSDRVBackbone=Llama 2, Split=PH, Seeding claims percentage=50%2024.06 | 84.2 | 80.4 | — | — | — | — | 82.9 | 77.4 | 82.4 | 78.7 | |
| JSDRV-BertBackbone=Bert, Split=PH, Seeding claims percentage=50%2024.06 | 81.3 | 78 | — | — | — | — | 81 | 76.2 | 75.6 | 79.2 | |
| TD-MILSplit=PH2024.06 | 80.9 | 77.6 | — | — | — | — | 82.6 | 65.9 | 66.9 | 85.2 | |
| PLANSplit=PH2024.06 | 80 | 74.3 | — | — | — | — | 81.9 | 76 | 78 | 61.2 | |
| BerTweet2024.06 | 76 | 45.2 | — | — | — | — | 64.1 | 29.3 | 36.7 | 46 | |
| DDGCNSplit=PH2024.06 | 75.9 | 66.3 | — | — | — | — | 71.3 | 66.3 | 66.9 | 60.7 | |
| Llama 2-MTBackbone=Llama 2, Task=Multi-Task2024.06 | 75.8 | 46.5 | — | — | — | — | 67.8 | 30.1 | 40.3 | 47.8 | |
| Llama 2-STBackbone=Llama 2, Task=Single-Task2024.06 | 75.4 | 45 | — | — | — | — | 66 | 27.1 | 40 | 46.9 | |
| TD-RVNNSplit=PH2024.06 | 75.3 | 67.7 | — | — | — | — | 75.5 | 66.6 | 67.3 | 61.5 | |
| SRLFSplit=PH2024.06 | 74.2 | 44.7 | — | — | — | — | 66.7 | 29 | 38.1 | 45.2 | |
| JSDRVData Split=PH2024.06 | 72.3 | 60.5 | 54.6 | 47.6 | 59.5 | 80.1 | — | — | — | — | |
| TD-MILData Split=PH2024.06 | 69.1 | 43.4 | 34.4 | 17.9 | 46.7 | 76.7 | — | — | — | — | |
| JSDRV-BertBackbone=BERT, Data Split=PH2024.06 | 68.3 | 56.5 | 53.5 | 38.3 | 57.3 | 76.5 | — | — | — | — | |
| GCANSplit=PH2024.06 | 64.5 | 25.3 | — | — | — | — | 24.9 | 31 | 11.3 | 33.9 | |
| SRLFData Split=PH2024.06 | 60.6 | 47.9 | 49.2 | 28 | 46.8 | 67.6 | — | — | — | — |