Out-of-Context Misinformation Detection on NewsCLIPpings Merged Balanced (test)
88.4Overall AccuracySNIFFER
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SNIFFERbase model=InstructBLIP, image encoder=ViT-G/14, LLM=Vicuna-13B2024.03 | 88.4 | 86.9 | 91.8 | |
| CCN2024.03 | 84.7 | 84.8 | 84.5 | |
| DT-Transformer2024.03 | 77.1 | 78.6 | 75.6 | |
| Neu-Sym detector2024.03 | 68.2 | — | — | |
| CLIP2024.03 | 66 | 64.3 | 67.7 | |
| VisualBERT2024.03 | 58.6 | 38.9 | 78.4 | |
| EANN2024.03 | 58.1 | 61.8 | 56.2 | |
| SAFE2024.03 | 52.8 | 54.8 | 52 |