Translation on Copyrighted Content without copyright notice 1.0 (test)
44.84Cosine SimilarityGemini-2.0
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini-2.0Availability=API-based2025.12 | 44.84 | 1.06 | |
| LLaVA-NeXT_13BParameters=13B2025.12 | 44.22 | 9.96 | |
| GLM-4v_9BParameters=9B2025.12 | 44.05 | 3.42 | |
| Claude-3.7Availability=API-based2025.12 | 39.21 | 2.79 | |
| Qwen2.5-VL_7BParameters=7B2025.12 | 38.73 | 3.98 | |
| Qwen2.5-VL_3BParameters=3B2025.12 | 38.59 | 5.01 | |
| Janus-Pro_7BParameters=7B2025.12 | 36.63 | 5.01 | |
| DeepSeek-VL_7BParameters=7B2025.12 | 36.4 | 8.42 | |
| GPT-4o-miniAvailability=API-based2025.12 | 33.96 | 11.82 | |
| LLaVA-1.5_13BParameters=13B2025.12 | 29.85 | 13.51 | |
| LLaVA-1.5_7BParameters=7B2025.12 | 27.07 | 5.98 | |
| GPT-4oAvailability=API-based2025.12 | 9.78 | 95.36 |