Idiomatic Translation on Inter-Indic te-xx
2.02LLM-eval ScoreIdiomCE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IdiomCEBackbone=Gemma2-9b-it2025.05 | 2.02 | 72.4 | |
| Indictrans2Inference Method=Direct2025.05 | 1.97 | 77 | |
| NLLB-200Inference Method=Direct2025.05 | 1.81 | 78 | |
| DirectBackbone=Gemma2-9b-it2025.05 | 1.5467 | 77.3 | |
| IdiomCEBackbone=LLama-3.1-8B2025.05 | 1.493 | 62.6 | |
| IdiomCEBackbone=LLama-3.2-3B2025.05 | 1.273 | 54.93 | |
| DirectBackbone=LLama-3.1-8B2025.05 | 1.25 | 67.7 | |
| DirectBackbone=LLama-3.2-3B2025.05 | 1.1867 | 60.9 |