Idiomatic Translation on Inter-Indic (ta-xx)
2.01LLM-eval ScoreIndictrans2
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Indictrans2Inference Method=Direct2025.05 | 2.01 | 0.77 | |
| IdiomCEBackbone=Gemma2-9b-it2025.05 | 1.9867 | 0.7267 | |
| NLLB-200Inference Method=Direct2025.05 | 1.84 | 0.77 | |
| DirectBackbone=Gemma2-9b-it2025.05 | 1.563 | 0.755 | |
| IdiomCEBackbone=LLama-3.1-8B2025.05 | 1.533 | 0.5993 | |
| IdiomCEBackbone=LLama-3.2-3B2025.05 | 1.2567 | 0.5387 | |
| DirectBackbone=LLama-3.2-3B2025.05 | 1.253 | 0.572 | |
| DirectBackbone=LLama-3.1-8B2025.05 | 1.25 | 0.6393 |