Web Image Translation on Multilingual Web Image Translation EN-JA
26.4BLEUVaaWIT on Qwen3 (8B)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VaaWIT on Qwen3 (8B)Backbone=Qwen3 (8B), Tuning Strategy=DSAM + VAA2026.05 | 26.4 | 83.9 | |
| VaaWIT on LLaMA3.1 (8B)Backbone=LLaMA3.1 (8B), Tuning Strategy=DSAM + VAA2026.05 | 26.2 | 83.1 | |
| GPT4.1†Tuning Strategy=Zero-Shot2026.05 | 23.7 | 81.6 | |
| Gemini2.5 Pro†Tuning Strategy=Zero-Shot2026.05 | 22.2 | 75.5 | |
| Qwen3-VL (32B)Tuning Strategy=Zero-Shot, Parameters=32B2026.05 | 15.5 | 55.9 | |
| Full Fine-TuningBackbone=Qwen3-VL (8B), Tuning Strategy=Full Fine-Tuning2026.05 | 15.3 | 51 | |
| Chain-of-ThoughtBackbone=Qwen3-VL (8B), Tuning Strategy=Prompting2026.05 | 13.5 | 67.7 | |
| Qwen3-VL (8B)Tuning Strategy=Zero-Shot, Parameters=8B2026.05 | 11.4 | 55.6 | |
| PP-OCR_Microsoft APIType=Cascaded Model2026.05 | 11.2 | 62.4 | |
| LoRABackbone=Qwen3-VL (8B), Tuning Strategy=LoRA (r=8)2026.05 | 9 | 58.8 | |
| EasyOCR_Google APIType=Cascaded Model2026.05 | 8.6 | 60.8 | |
| LLaMA3.2 (90B)Tuning Strategy=Zero-Shot, Parameters=90B2026.05 | 3.6 | 54.8 | |
| LLaVA-OV (7B)Tuning Strategy=Zero-Shot, Parameters=7B2026.05 | 3.4 | 49.7 | |
| LLaMA3.2 (11B)Tuning Strategy=Zero-Shot, Parameters=11B2026.05 | 1.6 | 50.7 |