# Translation on FLoRes+ En-YY (high resource level) Source: [Translation on FLoRes+ En-YY (high resource level)]() Collection index: [llms.txt]() Data updated: 2026-03-18T08:34:26.623Z Evaluation of Machine Translation performance for the En-YY language pair using the high resource level subset of the FLoRes+ dataset, measured by ChrF++. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Translation | | Dataset (including any stated split) | FLoRes+ En-YY, high resource level | | Metric | ChrF++ | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ChrF++](): Higher is better; unit: PERCENT. ## Recorded results | Method | ChrF++ | Result date | Report paper | | --- | --- | --- | --- | | Gemma 3 | 58.6 | Not recorded | 69ba31840636e5bf4afc076d | | GPT-OSS 120B | 58.2 | Not recorded | 69ba31840636e5bf4afc076d | | OMT-NLLB | 57.6 | Not recorded | 69ba31840636e5bf4afc076d | | OMT-LLaMA 8B | 57.4 | Not recorded | 69ba31840636e5bf4afc076d | | NLLB-200 | 57.2 | Not recorded | 69ba31840636e5bf4afc076d | | MADLAD | 57.2 | Not recorded | 69ba31840636e5bf4afc076d | | LLaMA 3 70B | 56.7 | Not recorded | 69ba31840636e5bf4afc076d | | EuroLLM | 55.7 | Not recorded | 69ba31840636e5bf4afc076d | | TranslateGemma | 55.4 | Not recorded | 69ba31840636e5bf4afc076d | | GPT-OSS 20B | 54.8 | Not recorded | 69ba31840636e5bf4afc076d | | Tower+ | 54.5 | Not recorded | 69ba31840636e5bf4afc076d | | Tiny Aya Global | 53.6 | Not recorded | 69ba31840636e5bf4afc076d | | LLaMA 3 8B | 51.4 | Not recorded | 69ba31840636e5bf4afc076d | | Aya-101 | 48.5 | Not recorded | 69ba31840636e5bf4afc076d | | Aya Expanse | 48 | Not recorded | 69ba31840636e5bf4afc076d | | Hunyuan-MT | 45.6 | Not recorded | 69ba31840636e5bf4afc076d | ### Gemma 3 ChrF++: 58.6. Result ID: 69ba637447f34ce924a44bf5. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-OSS 120B ChrF++: 58.2. Result ID: 69ba637447f34ce924a44bf7. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"120B"}. This record does not assert independent reproduction. ### OMT-NLLB ChrF++: 57.6. Result ID: 69ba637447f34ce924a44bf2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### OMT-LLaMA 8B ChrF++: 57.4. Result ID: 69ba637447f34ce924a44bf3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### NLLB-200 ChrF++: 57.2. Result ID: 69ba637447f34ce924a44bf4. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MADLAD ChrF++: 57.2. Result ID: 69ba637447f34ce924a44bf9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLaMA 3 70B ChrF++: 56.7. Result ID: 69ba637447f34ce924a44bf8. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"70B"}. This record does not assert independent reproduction. ### EuroLLM ChrF++: 55.7. Result ID: 69ba637447f34ce924a44c01. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### TranslateGemma ChrF++: 55.4. Result ID: 69ba637447f34ce924a44bf6. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-OSS 20B ChrF++: 54.8. Result ID: 69ba637447f34ce924a44bfa. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"20B"}. This record does not assert independent reproduction. ### Tower+ ChrF++: 54.5. Result ID: 69ba637447f34ce924a44bfc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Tiny Aya Global ChrF++: 53.6. Result ID: 69ba637447f34ce924a44bfe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLaMA 3 8B ChrF++: 51.4. Result ID: 69ba637447f34ce924a44bfd. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### Aya-101 ChrF++: 48.5. Result ID: 69ba637447f34ce924a44bfb. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Aya Expanse ChrF++: 48. Result ID: 69ba637447f34ce924a44c00. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Hunyuan-MT ChrF++: 45.6. Result ID: 69ba637447f34ce924a44bff. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.