# Translation on FLoRes+ XX-En v. low resource level Source: [Translation on FLoRes+ XX-En v. low resource level]() Collection index: [llms.txt]() Data updated: 2026-03-18T08:34:26.558Z Evaluation of Machine Translation performance using the low resource level subset of the FLoRes+ XX-En dataset, reporting ChrF++ scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Translation | | Dataset (including any stated split) | FLoRes+ XX-En v. low resource level | | Metric | ChrF++ | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ChrF++](): Higher is better; unit: PERCENT. ## Recorded results | Method | ChrF++ | Result date | Report paper | | --- | --- | --- | --- | | OMT-NLLB | 52.3 | Not recorded | 69ba31840636e5bf4afc076d | | NLLB-200 | 49.3 | Not recorded | 69ba31840636e5bf4afc076d | | OMT-LLaMA 8B | 48.3 | Not recorded | 69ba31840636e5bf4afc076d | | Gemma 3 | 48.1 | Not recorded | 69ba31840636e5bf4afc076d | | TranslateGemma | 47.5 | Not recorded | 69ba31840636e5bf4afc076d | | Tower+ | 45.8 | Not recorded | 69ba31840636e5bf4afc076d | | LLaMA 3 70B | 45.7 | Not recorded | 69ba31840636e5bf4afc076d | | GPT-OSS 120B | 44.7 | Not recorded | 69ba31840636e5bf4afc076d | | MADLAD | 44.3 | Not recorded | 69ba31840636e5bf4afc076d | | Aya-101 | 43.5 | Not recorded | 69ba31840636e5bf4afc076d | | GPT-OSS 20B | 40.7 | Not recorded | 69ba31840636e5bf4afc076d | | LLaMA 3 8B | 39.7 | Not recorded | 69ba31840636e5bf4afc076d | | Aya Expanse | 38.2 | Not recorded | 69ba31840636e5bf4afc076d | | EuroLLM | 38.2 | Not recorded | 69ba31840636e5bf4afc076d | | Hunyuan-MT | 37.7 | Not recorded | 69ba31840636e5bf4afc076d | | Tiny Aya Global | 35.6 | Not recorded | 69ba31840636e5bf4afc076d | ### OMT-NLLB ChrF++: 52.3. Result ID: 69ba637447f34ce924a44bd2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### NLLB-200 ChrF++: 49.3. Result ID: 69ba637447f34ce924a44bd4. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### OMT-LLaMA 8B ChrF++: 48.3. Result ID: 69ba637447f34ce924a44bd3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### Gemma 3 ChrF++: 48.1. Result ID: 69ba637447f34ce924a44bd5. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### TranslateGemma ChrF++: 47.5. Result ID: 69ba637447f34ce924a44bd6. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Tower+ ChrF++: 45.8. Result ID: 69ba637447f34ce924a44bdc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### LLaMA 3 70B ChrF++: 45.7. Result ID: 69ba637447f34ce924a44bd8. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"70B"}. This record does not assert independent reproduction. ### GPT-OSS 120B ChrF++: 44.7. Result ID: 69ba637447f34ce924a44bd7. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"120B"}. This record does not assert independent reproduction. ### MADLAD ChrF++: 44.3. Result ID: 69ba637447f34ce924a44bd9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Aya-101 ChrF++: 43.5. Result ID: 69ba637447f34ce924a44bdb. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### GPT-OSS 20B ChrF++: 40.7. Result ID: 69ba637447f34ce924a44bda. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"20B"}. This record does not assert independent reproduction. ### LLaMA 3 8B ChrF++: 39.7. Result ID: 69ba637447f34ce924a44bdd. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"8B"}. This record does not assert independent reproduction. ### Aya Expanse ChrF++: 38.2. Result ID: 69ba637447f34ce924a44be0. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### EuroLLM ChrF++: 38.2. Result ID: 69ba637447f34ce924a44be1. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Hunyuan-MT ChrF++: 37.7. Result ID: 69ba637447f34ce924a44bdf. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Tiny Aya Global ChrF++: 35.6. Result ID: 69ba637447f34ce924a44bde. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.