ResearchBenchmarksMachine Translation on Italian ItaBench trans-mcMachine Translation on Italian ItaBench trans-mcFollow0.542Average PerformanceGamayun0.50560.515050.52450.53395Dec 25, 2025Evaluation resultsMethodMethodLinksAverage PerformanceGamayunSize=1.47BSize=1.47B2025.120.542Qwen2.5Size=1.54BSize=1.54B2025.120.534EuroLMSize=1.7BSize=1.7B2025.120.533Qwen3Size=1.7BSize=1.7B2025.120.533Gemma3Size=1BSize=1B2025.120.531Llama3.2Size=1.24BSize=1.24B2025.120.507