Report Generation on MMTT
59.3CIDErForgeryTalker
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ForgeryTalkerSetting=Fine-Tuning2024.12 | 59.3 | 35 | 22.1 | 16 | 12.5 | 28.8 | |
| InstructBLIPSetting=Fine-Tuning2024.12 | 51.7 | 31.8 | 20.3 | 14.6 | 11.4 | 27.7 | |
| LISA-7BSetting=Fine-Tuning2024.12 | 44.1 | 31.1 | 17.9 | 10.8 | 8.5 | 28.4 | |
| SCASetting=Fine-Tuning2024.12 | 40.6 | 30.6 | 17.8 | 11.2 | 8.2 | 27.6 | |
| OspreySetting=Fine-Tuning2024.12 | 24.5 | 28.7 | 16.4 | 9.4 | 6.2 | 25.9 | |
| FFAASetting=Fine-Tuning2024.12 | 17.4 | 12 | 6.6 | 4 | 12.9 | 21.7 | |
| FakeShieldSetting=Fine-Tuning2024.12 | 10 | 9.1 | 4.3 | 2.3 | 12.3 | 16.7 | |
| llava (72B)Setting=Zero-Shot2024.12 | 3.06 | 22.01 | 8.35 | 3.3 | 1.8 | 16.83 | |
| Qwen2.5VL (72B)Setting=Zero-Shot2024.12 | 2.72 | 20.34 | 6.33 | 2.55 | 1.46 | 16.52 | |
| InternVL3 (78B)Setting=Zero-Shot2024.12 | 2.67 | 22.31 | 8.08 | 3.16 | 1.75 | 16.82 | |
| Seed1.5VLSetting=Zero-Shot2024.12 | 0.54 | 17.19 | 5.35 | 1.86 | 0.98 | 13.74 |