Idiomatic Translation on Mixed Dataset en-hi
2.39LLM-eval ScoreIdiomCE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| IdiomCEModel=GPT-4o2025.05 | 2.39 | 0.7 | |
| DirectModel=GPT-4o2025.05 | 2.14 | 0.73 | |
| IdiomCEModel=Gemma2-9b-it2025.05 | 1.88 | 0.68 | |
| IdiomCEModel=LLama-3.1-8B2025.05 | 1.655 | 0.63 | |
| DirectModel=Gemma2-9b-it2025.05 | 1.6 | 0.73 | |
| IdiomCEModel=LLama-3.2-3B2025.05 | 1.34 | 0.59 | |
| DirectModel=NLLB-2002025.05 | 1.3 | 0.7 | |
| DirectModel=LLama-3.1-8B2025.05 | 1.27 | 0.68 | |
| DirectModel=Indictrans22025.05 | 1.247 | 0.74 | |
| DirectModel=LLama-3.2-3B2025.05 | 1.12 | 0.62 |