# Translation on FLoRes+ En-YY (v. low resource level) Source: [Translation on FLoRes+ En-YY (v. low resource level)]() Collection index: [llms.txt]() Data updated: 2026-03-18T08:34:26.768Z Evaluation of Machine Translation performance for the En-YY language pair using the very low resource level subset of the FLoRes+ dataset, measured by ChrF++. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Translation | | Dataset (including any stated split) | FLoRes+ En-YY, v. low resource level | | Metric | ChrF++ | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ChrF++](): Higher is better; unit: PERCENT. ## Recorded results | Method | ChrF++ | Result date | Report paper | | --- | --- | --- | --- | | OMT-NLLB | 34.6 | Not recorded | 69ba31840636e5bf4afc076d | | OMT-LLaMA 8B | 33.8 | Not recorded | 69ba31840636e5bf4afc076d | | NLLB-200 | 32.5 | Not recorded | 69ba31840636e5bf4afc076d | | MADLAD | 29.3 | Not recorded | 69ba31840636e5bf4afc076d | | GPT-OSS 120B | 29.2 | Not recorded | 69ba31840636e5bf4afc076d | | TranslateGemma | 27.5 | Not recorded | 69ba31840636e5bf4afc076d | | Gemma 3 | 26.4 | Not recorded | 69ba31840636e5bf4afc076d | | LLaMA 3 70B | 26.3 | Not recorded | 69ba31840636e5bf4afc076d | | GPT-OSS 20B | 24.1 | Not recorded | 69ba31840636e5bf4afc076d | | Hunyuan-MT | 23.4 | Not recorded | 69ba31840636e5bf4afc076d | | Tower+ | 22.9 | Not recorded | 69ba31840636e5bf4afc076d | | EuroLLM | 22.3 | Not recorded | 69ba31840636e5bf4afc076d | | Aya Expanse | 21.8 | Not recorded | 69ba31840636e5bf4afc076d | | LLaMA 3 8B | 20.6 | Not recorded | 69ba31840636e5bf4afc076d | | Aya-101 | 20.3 | Not recorded | 69ba31840636e5bf4afc076d | | Tiny Aya Global | 19.7 | Not recorded | 69ba31840636e5bf4afc076d | ### OMT-NLLB ChrF++: 34.6. Result ID: 69ba637447f34ce924a44c22. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### OMT-LLaMA 8B ChrF++: 33.8. Result ID: 69ba637447f34ce924a44c23. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### NLLB-200 ChrF++: 32.5. Result ID: 69ba637447f34ce924a44c24. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MADLAD ChrF++: 29.3. Result ID: 69ba637447f34ce924a44c29. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-OSS 120B ChrF++: 29.2. Result ID: 69ba637447f34ce924a44c27. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"120B"}. This record does not assert independent reproduction. ### TranslateGemma ChrF++: 27.5. Result ID: 69ba637447f34ce924a44c26. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Gemma 3 ChrF++: 26.4. Result ID: 69ba637447f34ce924a44c25. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLaMA 3 70B ChrF++: 26.3. Result ID: 69ba637447f34ce924a44c28. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"70B"}. This record does not assert independent reproduction. ### GPT-OSS 20B ChrF++: 24.1. Result ID: 69ba637447f34ce924a44c2a. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"20B"}. This record does not assert independent reproduction. ### Hunyuan-MT ChrF++: 23.4. Result ID: 69ba637447f34ce924a44c2f. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Tower+ ChrF++: 22.9. Result ID: 69ba637447f34ce924a44c2c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### EuroLLM ChrF++: 22.3. Result ID: 69ba637447f34ce924a44c31. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Aya Expanse ChrF++: 21.8. Result ID: 69ba637447f34ce924a44c30. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLaMA 3 8B ChrF++: 20.6. Result ID: 69ba637447f34ce924a44c2d. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### Aya-101 ChrF++: 20.3. Result ID: 69ba637447f34ce924a44c2b. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Tiny Aya Global ChrF++: 19.7. Result ID: 69ba637447f34ce924a44c2e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.