Machine Translation on Seen Dataset en-bn 1.0
1.84GPT-4 ScoreIdiomCE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IdiomCEBackbone=Gemma2-9b-it2025.05 | 1.84 | 69 | |
| SIABackbone=LLama-3.1-8B2025.05 | 1.84 | 69 | |
| IdiomKBBackbone=Gemma2-9b-it2025.05 | 1.64 | 70 | |
| IdiomCEBackbone=LLama-3.1-8B2025.05 | 1.54 | 63 | |
| DirectBackbone=Gemma2-9b-it2025.05 | 1.5 | 71 | |
| LIABackbone=LLama-3.1-8B2025.05 | 1.5 | 63.2 | |
| NLLB-200Methods=Direct2025.05 | 1.45 | 77 | |
| SIABackbone=Gemma2-9b-it2025.05 | 1.3 | 63 | |
| Indictrans2Methods=Direct2025.05 | 1.27 | 78 | |
| IdiomCEBackbone=LLama-3.2-3B2025.05 | 1.26 | 59 | |
| DirectBackbone=LLama-3.1-8B2025.05 | 1.22 | 67 | |
| IdiomKBBackbone=LLama-3.1-8B2025.05 | 1.19 | 67 | |
| LIABackbone=Gemma2-9b-it2025.05 | 1.18 | 61 | |
| SIABackbone=LLama-3.2-3B2025.05 | 1.15 | 58 | |
| DirectBackbone=LLama-3.2-3B2025.05 | 1.06 | 60 | |
| IdiomKBBackbone=LLama-3.2-3B2025.05 | 1.05 | 59 | |
| LIABackbone=LLama-3.2-3B2025.05 | 1.01 | 57.02 |