Misinformation Detection on SLN (test)
94.22Micro F1KALM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| KALMtype=Knowledge-Aware LM2022.10 | 94.22 | 94.18 | — | — | |
| KALMCategory=task agnostic2022.10 | 94.22 | 94.18 | 94.33 | 94.22 | |
| KGAPtype=Knowledge-Aware LM2022.10 | 92.17 | 92.3 | — | — | |
| KGAPCategory=task agnostic2022.10 | 92.17 | 92.3 | 92.67 | 92.17 | |
| Task-specific baseline SOTA2022.10 | 89.17 | 89.12 | — | — | |
| CompareNetCategory=task specific2022.10 | 89.17 | 89.12 | 89.82 | 89.17 | |
| Pretrained Language Model (BestLM)2022.10 | 88.17 | 88.46 | — | — | |
| GreaseLM+type=Knowledge-Aware LM2022.10 | 88.17 | 88.64 | — | — | |
| RoBERTaCategory=language model2022.10 | 88.17 | 87.34 | 89.02 | 88.17 | |
| GreaseLM+Category=task agnostic2022.10 | 88.17 | 88.64 | 88.56 | 88.17 | |
| LongFormerCategory=language model2022.10 | 88 | 86.29 | 88.84 | 87.44 | |
| DeBERTaCategory=language model2022.10 | 86.89 | 88.46 | 89.43 | 86.89 | |
| BARTCategory=language model2022.10 | 86.06 | 86.12 | 86.13 | 86.06 | |
| GCN + AttnCategory=task specific2022.10 | 85.27 | 85.24 | 85.59 | 85.27 | |
| GAT + AttnCategory=task specific2022.10 | 84.72 | 84.62 | 85.65 | 84.72 | |
| KELMtype=Knowledge-Aware LM2022.10 | 84.11 | 82.8 | — | — | |
| KELMCategory=task agnostic2022.10 | 84.11 | 82.8 | 85.23 | 84.11 | |
| Joshi et al.type=Knowledge-Aware LM2022.10 | 82.72 | 83.98 | — | — | |
| Joshi et al.Category=task agnostic2022.10 | 82.72 | 83.98 | 84.95 | 83.37 | |
| KnowBERTtype=Knowledge-Aware LM2022.10 | 78.67 | 79.8 | — | — | |
| KnowBERT-W+WCategory=task agnostic2022.10 | 78.67 | 79.8 | 79.36 | 78.67 | |
| ElectraCategory=language model2022.10 | 75.44 | 67.53 | 83.22 | 75.44 | |
| KnowBERT-WordnetCategory=task agnostic2022.10 | 74.72 | 72.74 | 77.22 | 74.72 | |
| GreaseLMtype=Knowledge-Aware LM2022.10 | 73.83 | 75.2 | — | — | |
| GreaseLMCategory=task agnostic2022.10 | 73.83 | 75.2 | 74.33 | 73.83 | |
| KnowBERT-WikidataCategory=task agnostic2022.10 | 72.17 | 69.41 | 73.57 | 72.17 | |
| Rubin et al.Category=task specific2022.10 | — | — | 88 | 82 |