Image2Code on Real-world images corpus State D3
3Character Error Rate (CEr)Gemma3-12B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Gemma3-12B2026.01 | 3 | 76 | 61 | 52 | |
| GPT-4o-mini2026.01 | 3 | 81 | 65 | 56 | |
| Llama-VL-TUGstatus=Fine-tuned, backbone=Llama3.2-11B-Vision-Instruct2026.01 | 16 | 52 | 31 | 19 | |
| MiniCPM-V-2-62026.01 | 24 | 68 | 29 | 5 | |
| Qwen2.5-VL-7B2026.01 | 44 | 52 | 38 | 34 | |
| Llama3.2-11Bstatus=Vanilla2026.01 | 73 | 34 | 19 | 0 |