# MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining

Source: [MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining](<https://www.sota2.com/research/paper/68fa79c41e209131cea7f3f5>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-07T05:00:04.447Z

Authors: Zhixun Chen, Ping Guo, Wenhan Han, Yifan Zhang, Binbin Liu, Haobin Lin, Fengze Liu, Yan Zhao, Bingni Zhang, Taifeng Wang, Yin Zheng, Trevor Cohn, Meng Fang

Published: 2025-07-02T15:11:12.000Z

## Abstract

Data quality is a critical driver of large language model performance, yet existing model-based selection methods focus almost exclusively on English. We introduce MuRating, a scalable framework that transfers high-quality English data-quality signals into a single rater for 17 target languages. MuRating aggregates multiple English "raters" via pairwise comparisons to learn unified document-quality scores,then projects these judgments through translation to train a multilingual evaluator on monolingual, cross-lingual, and parallel text pairs. Applied to web data, MuRating selects balanced subsets of English and multilingual content to pretrain a 1.2 B-parameter LLaMA model. Compared to strong baselines, including QuRater, AskLLM, DCLM and so on, our approach boosts average accuracy on both English benchmarks and multilingual evaluations, with especially large gains on knowledge-intensive tasks. We further analyze translation fidelity, selection biases, and underrepresentation of narrative material, outlining directions for future work.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Multilingual LLM Evaluation on Multilingual Benchmarks 18 Languages](<https://www.sota2.com/research/sota/multilingual-llm-evaluation-on-multilingual-benchmarks-18-languages.md>): Multilingual LLM Evaluation; Multilingual Benchmarks 18 Languages; Reading Comprehension: 62.78.

- [Language Modeling Downstream Evaluation on English Downstream Tasks 12 tasks](<https://www.sota2.com/research/sota/language-modeling-downstream-evaluation-on-english-downstream-tasks-12-tasks.md>): Language Modeling Downstream Evaluation; English Downstream Tasks 12 tasks; Reading Comprehension: 47.13.

- [Multilingual LLM Evaluation on Multilingual Benchmarks 13 Languages](<https://www.sota2.com/research/sota/multilingual-llm-evaluation-on-multilingual-benchmarks-13-languages.md>): Multilingual LLM Evaluation; Multilingual Benchmarks 13 Languages; Reading Comprehension Accuracy: 55.95.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2507.01785>)

[PDF](<https://arxiv.org/pdf/2507.01785.pdf>)
