# Translation on FLoRes+ En-YY (total) Source: [Translation on FLoRes+ En-YY (total)]() Collection index: [llms.txt]() Data updated: 2026-03-18T08:34:26.791Z Evaluation of Machine Translation performance for the FLoRes+ En-YY total set, measured using ChrF++. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Translation | | Dataset (including any stated split) | FLoRes+ En-YY (total) | | Metric | ChrF++ | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ChrF++](): Higher is better; unit: PERCENT. ## Recorded results | Method | ChrF++ | Result date | Report paper | | --- | --- | --- | --- | | OMT-NLLB | 44.6 | Not recorded | 69ba31840636e5bf4afc076d | | OMT-LLaMA 8B | 44.2 | Not recorded | 69ba31840636e5bf4afc076d | | NLLB-200 | 43 | Not recorded | 69ba31840636e5bf4afc076d | | GPT-OSS 120B | 38.8 | Not recorded | 69ba31840636e5bf4afc076d | | Gemma 3 | 38.1 | Not recorded | 69ba31840636e5bf4afc076d | | TranslateGemma | 37.2 | Not recorded | 69ba31840636e5bf4afc076d | | LLaMA 3 70B | 36.8 | Not recorded | 69ba31840636e5bf4afc076d | | MADLAD | 35.7 | Not recorded | 69ba31840636e5bf4afc076d | | GPT-OSS 20B | 32.6 | Not recorded | 69ba31840636e5bf4afc076d | | Aya-101 | 29.9 | Not recorded | 69ba31840636e5bf4afc076d | | Tower+ | 28.8 | Not recorded | 69ba31840636e5bf4afc076d | | LLaMA 3 8B | 27.9 | Not recorded | 69ba31840636e5bf4afc076d | | Tiny Aya Global | 27.4 | Not recorded | 69ba31840636e5bf4afc076d | | Hunyuan-MT | 24.9 | Not recorded | 69ba31840636e5bf4afc076d | | Aya Expanse | 24.9 | Not recorded | 69ba31840636e5bf4afc076d | | EuroLLM | 23.2 | Not recorded | 69ba31840636e5bf4afc076d | ### OMT-NLLB ChrF++: 44.6. Result ID: 69ba637447f34ce924a44c32. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### OMT-LLaMA 8B ChrF++: 44.2. Result ID: 69ba637447f34ce924a44c33. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### NLLB-200 ChrF++: 43. Result ID: 69ba637447f34ce924a44c34. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-OSS 120B ChrF++: 38.8. Result ID: 69ba637447f34ce924a44c37. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"120B"}. This record does not assert independent reproduction. ### Gemma 3 ChrF++: 38.1. Result ID: 69ba637447f34ce924a44c35. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### TranslateGemma ChrF++: 37.2. Result ID: 69ba637447f34ce924a44c36. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLaMA 3 70B ChrF++: 36.8. Result ID: 69ba637447f34ce924a44c38. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"70B"}. This record does not assert independent reproduction. ### MADLAD ChrF++: 35.7. Result ID: 69ba637447f34ce924a44c39. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-OSS 20B ChrF++: 32.6. Result ID: 69ba637447f34ce924a44c3a. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"20B"}. This record does not assert independent reproduction. ### Aya-101 ChrF++: 29.9. Result ID: 69ba637447f34ce924a44c3b. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Tower+ ChrF++: 28.8. Result ID: 69ba637447f34ce924a44c3c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLaMA 3 8B ChrF++: 27.9. Result ID: 69ba637447f34ce924a44c3d. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### Tiny Aya Global ChrF++: 27.4. Result ID: 69ba637447f34ce924a44c3e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Hunyuan-MT ChrF++: 24.9. Result ID: 69ba637447f34ce924a44c3f. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Aya Expanse ChrF++: 24.9. Result ID: 69ba637447f34ce924a44c40. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### EuroLLM ChrF++: 23.2. Result ID: 69ba637447f34ce924a44c41. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.