Forgery Type Identification on Synthbuster
94AccuracyFKG
Evaluation Results
| Method | Links | |
|---|---|---|
| FKGScenario=Real-world2026.06 | 94 | |
| Sonnet 4Scenario=Oracle-assisted2026.06 | 86 | |
| Gemma 3Scenario=Oracle-assisted2026.06 | 72 | |
| Qwen3 VLScenario=Real-world, VLM Type=Thinking2026.06 | 65 | |
| Qwen3 VLScenario=Oracle-assisted, VLM Type=Thinking2026.06 | 63 | |
| Gemini 2.0Scenario=Oracle-assisted2026.06 | 61 | |
| GPT-5Scenario=Oracle-assisted2026.06 | 57 | |
| GPT-5Scenario=Real-world2026.06 | 56 | |
| Sonnet 4Scenario=Real-world2026.06 | 55 | |
| Gemini 2.0Scenario=Real-world2026.06 | 54 | |
| Qwen3 VLScenario=Real-world, VLM Type=Instruct2026.06 | 51 | |
| Gemma 3Scenario=Real-world2026.06 | 50 | |
| Qwen3 VLScenario=Oracle-assisted, VLM Type=Instruct2026.06 | 39 | |
| Llama 4 S.Scenario=Real-world2026.06 | 21 | |
| Nemotron N.Scenario=Oracle-assisted2026.06 | 21 | |
| Llama 4 S.Scenario=Oracle-assisted2026.06 | 8 | |
| Nemotron N.Scenario=Real-world2026.06 | 5 |