Forgery Type Identification on FKG-50K
95AI-Edit AccuracyGemma 3
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Gemma 3Scenario=Oracle-assisted2026.06 | 95 | 35 | 10 | 5 | 36 | — | — | — | — | — | — | — | — | — | — | |
| FKGScenario=Real-world2026.06 | 81 | 84 | 92 | 89 | 87 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3 VLScenario=Oracle-assisted, VLM Type=Thinking2026.06 | 49 | 40 | 34 | 28 | 38 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3 VLScenario=Real-world, VLM Type=Thinking2026.06 | 45 | 45 | 29 | 5 | 31 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3 VLScenario=Oracle-assisted, VLM Type=Instruct2026.06 | 37 | 13 | 16 | 77 | 36 | — | — | — | — | — | — | — | — | — | — | |
| Nemotron N.Scenario=Oracle-assisted2026.06 | 25 | 33 | 40 | 43 | 35 | — | — | — | — | — | — | — | — | — | — | |
| Nemotron N.Scenario=Real-world2026.06 | 17 | 6 | 12 | 11 | 12 | — | — | — | — | — | — | — | — | — | — | |
| Gemma 3Scenario=Real-world2026.06 | 13 | 28 | 25 | 21 | 22 | — | — | — | — | — | — | — | — | — | — | |
| Sonnet 4Scenario=Oracle-assisted2026.06 | 10 | 80 | 32 | 71 | 48 | — | — | — | — | — | — | — | — | — | — | |
| Llama 4 S.Scenario=Oracle-assisted2026.06 | 6 | 91 | 1 | 1 | 25 | — | — | — | — | — | — | — | — | — | — | |
| Sonnet 4Scenario=Real-world2026.06 | 4 | 44 | 4 | 2 | 14 | — | — | — | — | — | — | — | — | — | — | |
| Llama 4 S.Scenario=Real-world2026.06 | 4 | 15 | 2 | 16 | 9 | — | — | — | — | — | — | — | — | — | — | |
| GPT-5Scenario=Real-world2026.06 | 3 | 29 | 49 | 12 | 23 | — | — | — | — | — | — | — | — | — | — | |
| Gemini 2.0Scenario=Real-world2026.06 | 3 | 23 | 40 | 4 | 18 | — | — | — | — | — | — | — | — | — | — | |
| Qwen3 VLScenario=Real-world, VLM Type=Instruct2026.06 | 3 | 19 | 10 | 2 | 9 | — | — | — | — | — | — | — | — | — | — | |
| GPT-5Scenario=Oracle-assisted2026.06 | 2 | 39 | 75 | 56 | 43 | — | — | — | — | — | — | — | — | — | — | |
| Gemini 2.0Scenario=Oracle-assisted2026.06 | 1 | 40 | 54 | 91 | 47 | — | — | — | — | — | — | — | — | — | — | |
| FKG2026.06 | — | — | — | — | — | 69 | 77 | 86 | 96 | 81 | 92 | 65 | 75 | 75 | 85 | |
| Gemini 2.02026.06 | — | — | — | — | — | 17 | 2 | 30 | 14 | 38 | 6 | 10 | 3 | 24 | 6 | |
| Gemma 32026.06 | — | — | — | — | — | 36 | 10 | 28 | 14 | 24 | 7 | 6 | 2 | 23 | 8 | |
| GPT-52026.06 | — | — | — | — | — | 15 | 5 | 28 | 16 | 33 | 12 | 8 | 3 | 21 | 9 | |
| Llama 4 S.2026.06 | — | — | — | — | — | 5 | 1 | 62 | 28 | 3 | 1 | 0 | 0 | 17 | 8 | |
| Nemotron N.2026.06 | — | — | — | — | — | 21 | 8 | 18 | 13 | 18 | 8 | 7 | 3 | 16 | 8 | |
| Qwen3 VLmode=I2026.06 | — | — | — | — | — | 25 | 8 | 5 | 5 | 26 | 8 | 15 | 6 | 18 | 7 | |
| Qwen3 VLmode=T2026.06 | — | — | — | — | — | 28 | 9 | 20 | 14 | 30 | 9 | 11 | 4 | 22 | 9 | |
| Sonnet 42026.06 | — | — | — | — | — | 17 | 5 | 37 | 27 | 16 | 5 | 5 | 3 | 19 | 10 |