Machine Translation on Seen Dataset en-ta 1.0
1.76GPT-4 ScoreIdiomCE
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| IdiomCEBackbone=Gemma2-9b-it2025.05 | 1.76 | 0.68 | |
| IdiomKBBackbone=Gemma2-9b-it2025.05 | 1.65 | 0.68 | |
| DirectBackbone=Gemma2-9b-it2025.05 | 1.6 | 0.72 | |
| SIABackbone=LLama-3.1-8B2025.05 | 1.6 | 0.65 | |
| LIABackbone=LLama-3.1-8B2025.05 | 1.42 | 0.61 | |
| IdiomCEBackbone=LLama-3.1-8B2025.05 | 1.29 | 0.57 | |
| Indictrans2Methods=Direct2025.05 | 1.26 | 0.76 | |
| SIABackbone=Gemma2-9b-it2025.05 | 1.23 | 0.562 | |
| NLLB-200Methods=Direct2025.05 | 1.21 | 0.69 | |
| IdiomKBBackbone=LLama-3.1-8B2025.05 | 1.2 | 0.6 | |
| LIABackbone=Gemma2-9b-it2025.05 | 1.184 | 0.554 | |
| DirectBackbone=LLama-3.1-8B2025.05 | 1.16 | 0.62 | |
| IdiomCEBackbone=LLama-3.2-3B2025.05 | 1.15 | 0.52 | |
| SIABackbone=LLama-3.2-3B2025.05 | 1.1 | 0.53 | |
| IdiomKBBackbone=LLama-3.2-3B2025.05 | 1.07 | 0.52 | |
| DirectBackbone=LLama-3.2-3B2025.05 | 1.03 | 0.51 | |
| LIABackbone=LLama-3.2-3B2025.05 | 0.97 | 0.51 |