Artifact Localization on SynthScars (test)
0.14mIoUInternVL3.5-8B + ArtiAgent
Evaluation results
| Method | Links | ||
|---|---|---|---|
| InternVL3.5-8B + ArtiAgentMode=Fine-tuned with ArtiAgent, Training Set Size=100K2026.02 | 0.14 | 0.217 | |
| Qwen2.5-VL-7B + ArtiAgentMode=Fine-tuned with ArtiAgent, Training Set Size=100K2026.02 | 0.137 | 0.214 | |
| GPT-5System Category=Proprietary VLM2026.02 | 0.117 | 0.185 | |
| LEGIONMethod Type=Artifact Segmentation Algorithm, Trained on SynthScars training set=true2026.02 | 0.106 | 0.152 | |
| DiffDoctorMethod Type=Artifact Segmentation Algorithm2026.02 | 0.083 | 0.136 | |
| Gemini-2.5-ProSystem Category=Proprietary VLM2026.02 | 0.064 | 0.101 | |
| PALMethod Type=Artifact Segmentation Algorithm2026.02 | 0.035 | 0.053 | |
| GPT-4oSystem Category=Proprietary VLM2026.02 | 0.032 | 0.052 | |
| InternVL3.5-8BMode=Vanilla2026.02 | 0.019 | 0.033 | |
| Qwen2.5-VL-7BMode=Vanilla2026.02 | 0.013 | 0.018 |