Idiomatic Translation on Inter-Indic hi-xx
1.92LLM-eval ScoreIndictrans2
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Indictrans2Inference Method=Direct2025.05 | 1.92 | 81 | |
| NLLB-200Inference Method=Direct2025.05 | 1.85 | 79 | |
| IdiomCEBackbone=Gemma2-9b-it2025.05 | 1.8233 | 72.83 | |
| DirectBackbone=Gemma2-9b-it2025.05 | 1.4833 | 75 | |
| IdiomCEBackbone=LLama-3.1-8B2025.05 | 1.42 | 61.6 | |
| DirectBackbone=LLama-3.1-8B2025.05 | 1.34 | 65.33 | |
| IdiomCEBackbone=LLama-3.2-3B2025.05 | 1.263 | 56.63 | |
| DirectBackbone=LLama-3.2-3B2025.05 | 1.1867 | 58.9 |