Rumor Verification on SemEval-8 (Public Holdout (PH))
83.4Micro F1JSDRV
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| JSDRVBackbone=Llama 2, Split=PH, Seeding claims percentage=50%2024.06 | 83.4 | 78.4 | 82 | 74.1 | 79.2 | |
| TD-MILSplit=PH2024.06 | 79.8 | 74.1 | 74.1 | 67.2 | 81 | |
| JSDRV-BertBackbone=Bert, Split=PH, Seeding claims percentage=50%2024.06 | 79.6 | 74.6 | 77.9 | 71.2 | 74.7 | |
| PLANSplit=PH2024.06 | 79.4 | 72 | 74.1 | 69.4 | 72.6 | |
| Llama 2-MTBackbone=Llama 2, Task=Multi-Task2024.06 | 75.6 | 42.7 | 63.5 | 26.3 | 38.2 | |
| BerTweet2024.06 | 75.5 | 42.7 | 63 | 25.6 | 39.5 | |
| DDGCNSplit=PH2024.06 | 75.5 | 68.5 | 70.9 | 62.4 | 72.3 | |
| TD-RVNNSplit=PH2024.06 | 74.8 | 69.4 | 71.2 | 61.7 | 75.3 | |
| Llama 2-STBackbone=Llama 2, Task=Single-Task2024.06 | 74.6 | 42.4 | 63.2 | 26 | 38 | |
| SRLFSplit=PH2024.06 | 74.2 | 42.3 | 63.5 | 24.9 | 38.6 | |
| GCANSplit=PH2024.06 | 64.5 | 25.5 | 24.1 | 32.6 | 19.8 |