List your company
ResearchFormerly WizWand

Idiomatic Translation on Mixed Dataset en-bn

2.25LLM-eval ScoreIdiomCE
1.0021.3261.651.974May 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
IdiomCEModel=GPT-4o2025.052.2569
DirectModel=GPT-4o2025.051.9976.4
IdiomCEBackbone=Gemma2-9b-it2025.051.78372.7
Indictrans2Inference Method=Direct2025.051.7881
IdiomCEModel=Gemma2-9b-it2025.051.768
NLLB-200Inference Method=Direct2025.051.778
DirectBackbone=Gemma2-9b-it2025.051.4977.5
IdiomCEBackbone=LLama-3.1-8B2025.051.4664.04
DirectModel=Gemma2-9b-it2025.051.4471
DirectModel=NLLB-2002025.051.4376.9
IdiomCEModel=LLama-3.1-8B2025.051.463
DirectBackbone=LLama-3.1-8B2025.051.36768.8
DirectModel=Indictrans22025.051.27577
DirectModel=LLama-3.1-8B2025.051.2367
IdiomCEBackbone=LLama-3.2-3B2025.051.2358.67
IdiomCEModel=LLama-3.2-3B2025.051.260
DirectBackbone=LLama-3.2-3B2025.051.1761.63
DirectModel=LLama-3.2-3B2025.051.0560