# Translation on FLoRes+ En-YY (low resource level) Source: [Translation on FLoRes+ En-YY (low resource level)]() Collection index: [llms.txt]() Data updated: 2026-03-18T08:34:26.730Z Evaluation of Machine Translation performance for the En-YY language pair using the low resource level subset of the FLoRes+ dataset, measured by ChrF++. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Translation | | Dataset (including any stated split) | FLoRes+ En-YY, low resource level | | Metric | ChrF++ | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ChrF++](): Higher is better; unit: PERCENT. ## Recorded results | Method | ChrF++ | Result date | Report paper | | --- | --- | --- | --- | | OMT-NLLB | 41 | Not recorded | 69ba31840636e5bf4afc076d | | OMT-LLaMA 8B | 39.8 | Not recorded | 69ba31840636e5bf4afc076d | | NLLB-200 | 39.4 | Not recorded | 69ba31840636e5bf4afc076d | | GPT-OSS 120B | 31.7 | Not recorded | 69ba31840636e5bf4afc076d | | Gemma 3 | 31.5 | Not recorded | 69ba31840636e5bf4afc076d | | MADLAD | 31.4 | Not recorded | 69ba31840636e5bf4afc076d | | LLaMA 3 70B | 31.1 | Not recorded | 69ba31840636e5bf4afc076d | | TranslateGemma | 30.5 | Not recorded | 69ba31840636e5bf4afc076d | | GPT-OSS 20B | 25 | Not recorded | 69ba31840636e5bf4afc076d | | Aya-101 | 22.9 | Not recorded | 69ba31840636e5bf4afc076d | | Tower+ | 22.6 | Not recorded | 69ba31840636e5bf4afc076d | | LLaMA 3 8B | 21.7 | Not recorded | 69ba31840636e5bf4afc076d | | Hunyuan-MT | 20.5 | Not recorded | 69ba31840636e5bf4afc076d | | Aya Expanse | 20.1 | Not recorded | 69ba31840636e5bf4afc076d | | Tiny Aya Global | 19.5 | Not recorded | 69ba31840636e5bf4afc076d | | EuroLLM | 18.8 | Not recorded | 69ba31840636e5bf4afc076d | ### OMT-NLLB ChrF++: 41. Result ID: 69ba637447f34ce924a44c12. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### OMT-LLaMA 8B ChrF++: 39.8. Result ID: 69ba637447f34ce924a44c13. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### NLLB-200 ChrF++: 39.4. Result ID: 69ba637447f34ce924a44c14. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-OSS 120B ChrF++: 31.7. Result ID: 69ba637447f34ce924a44c17. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"120B"}. This record does not assert independent reproduction. ### Gemma 3 ChrF++: 31.5. Result ID: 69ba637447f34ce924a44c15. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MADLAD ChrF++: 31.4. Result ID: 69ba637447f34ce924a44c19. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLaMA 3 70B ChrF++: 31.1. Result ID: 69ba637447f34ce924a44c18. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"70B"}. This record does not assert independent reproduction. ### TranslateGemma ChrF++: 30.5. Result ID: 69ba637447f34ce924a44c16. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-OSS 20B ChrF++: 25. Result ID: 69ba637447f34ce924a44c1a. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"20B"}. This record does not assert independent reproduction. ### Aya-101 ChrF++: 22.9. Result ID: 69ba637447f34ce924a44c1b. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Tower+ ChrF++: 22.6. Result ID: 69ba637447f34ce924a44c1c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLaMA 3 8B ChrF++: 21.7. Result ID: 69ba637447f34ce924a44c1d. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### Hunyuan-MT ChrF++: 20.5. Result ID: 69ba637447f34ce924a44c1f. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Aya Expanse ChrF++: 20.1. Result ID: 69ba637447f34ce924a44c20. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Tiny Aya Global ChrF++: 19.5. Result ID: 69ba637447f34ce924a44c1e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### EuroLLM ChrF++: 18.8. Result ID: 69ba637447f34ce924a44c21. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.