Machine Translation on Seen Dataset en-hi 1.0
2.08GPT-4 ScoreIdiomCE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| IdiomCEBackbone=Gemma2-9b-it2025.05 | 2.08 | 0.69 | |
| SIABackbone=LLama-3.1-8B2025.05 | 2.08 | 0.69 | |
| IdiomCEBackbone=LLama-3.1-8B2025.05 | 1.89 | 0.62 | |
| IdiomKBBackbone=Gemma2-9b-it2025.05 | 1.875 | 0.7 | |
| DirectBackbone=Gemma2-9b-it2025.05 | 1.63 | 0.73 | |
| LIABackbone=LLama-3.1-8B2025.05 | 1.6 | 0.645 | |
| IdiomCEBackbone=LLama-3.2-3B2025.05 | 1.42 | 0.58 | |
| SIABackbone=Gemma2-9b-it2025.05 | 1.41 | 0.65 | |
| IdiomKBBackbone=LLama-3.1-8B2025.05 | 1.4 | 0.67 | |
| NLLB-200Methods=Direct2025.05 | 1.34 | 0.7 | |
| LIABackbone=Gemma2-9b-it2025.05 | 1.3 | 0.64 | |
| DirectBackbone=LLama-3.1-8B2025.05 | 1.27 | 0.68 | |
| IdiomKBBackbone=LLama-3.2-3B2025.05 | 1.25 | 0.61 | |
| Indictrans2Methods=Direct2025.05 | 1.24 | 0.74 | |
| SIABackbone=LLama-3.2-3B2025.05 | 1.18 | 0.57 | |
| LIABackbone=LLama-3.2-3B2025.05 | 1.13 | 0.565 | |
| DirectBackbone=LLama-3.2-3B2025.05 | 1.12 | 0.62 |