Multi-modal manipulation detection on ROM NYT domain 1.0 (test)
96.69AccuracyREFORM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| REFORMSetting=Train on NYT2026.03 | 96.69 | 91.76 | 88.34 | |
| FKA-OwlSetting=Train on NYT, Method Category=Deepfake Detectors2026.03 | 95.76 | 89.66 | 74.13 | |
| LLaVa-v1.6-7BSetting=Train on NYT, Method Category=Fine-tuned LVLMs2026.03 | 94.42 | 81.23 | 83.87 | |
| AMDSetting=Train on NYT, Method Category=Deepfake Detectors2026.03 | 94.13 | 89.28 | 89.22 | |
| Qwen2.5-3BSetting=Train on NYT, Method Category=Fine-tuned LVLMs2026.03 | 86.76 | 57.54 | 65.34 | |
| HAMMER++Setting=Train on NYT, Method Category=Deepfake Detectors2026.03 | 82.91 | 74.07 | 59.92 | |
| HAMMERSetting=Train on NYT, Method Category=Deepfake Detectors2026.03 | 81.49 | 73.97 | 59.53 | |
| ViLTSetting=Train on NYT, Method Category=Deepfake Detectors2026.03 | 80.17 | 69.71 | 32.07 | |
| FKA-OwlSetting=Train on Guardian, Method Category=Deepfake Detectors2026.03 | 75.46 | 45.14 | 56.41 | |
| REFORMSetting=Train on Guardian2026.03 | 74.38 | 63.62 | 67.53 | |
| AMDSetting=Train on Guardian, Method Category=Deepfake Detectors2026.03 | 74.23 | 42.98 | 64.49 | |
| HAMMERSetting=Train on Guardian, Method Category=Deepfake Detectors2026.03 | 71.15 | 49.74 | 47.24 | |
| HAMMER++Setting=Train on Guardian, Method Category=Deepfake Detectors2026.03 | 70.79 | 47.57 | 47.61 | |
| ViLTSetting=Train on Guardian, Method Category=Deepfake Detectors2026.03 | 68.06 | 47.36 | 38.44 | |
| LLaVa-v1.6-7BSetting=Train on Guardian, Method Category=Fine-tuned LVLMs2026.03 | 63.15 | 23.14 | 65.35 | |
| Qwen2.5-3BSetting=Train on Guardian, Method Category=Fine-tuned LVLMs2026.03 | 61.9 | 22.23 | 61.99 | |
| MMD-Agent-34BSetting=Zero-Shot2026.03 | 61.34 | 41.63 | 40.46 | |
| GPT-4oSetting=Zero-Shot2026.03 | 51.98 | 42.15 | 16.42 | |
| Gemini-2.5Setting=Zero-Shot2026.03 | 50.86 | 42.73 | 15.41 | |
| Qwen2.5-VL-72BSetting=Zero-Shot2026.03 | 50.74 | 42.24 | 12.79 | |
| LLaVA-v1.6-34BSetting=Zero-Shot2026.03 | 47.66 | 41.09 | 7.45 | |
| DeepSeek-VL2-27BSetting=Zero-Shot2026.03 | 45.74 | 34.01 | 8.21 | |
| Yi-VL-6BSetting=Zero-Shot2026.03 | 31.03 | 21.86 | 2.67 |