Image Transliteration on Javanese 1.0 (test)
3.83BLEUGemma-3-12B-it
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Gemma-3-12B-itmode=Zero-shot2026.01 | 3.83 | 24.15 | 625.47 | |
| Qwen3-VL-8Bmode=Zero-shot2026.01 | 2.91 | 16.5 | 316.89 | |
| Llama-3.1-Nemotron-Nano-VL-8B-V1mode=Zero-shot2026.01 | 0.52 | 8.82 | 907.54 | |
| InternVL3.5-8Bmode=Zero-shot2026.01 | 0 | 17.1 | 1,947.98 | |
| GPT-5-Nanomode=Zero-shot2026.01 | 0 | 0 | 161.94 |