# Systematic Inequalities in Language Technology Performance across the World's Languages

Source: [Systematic Inequalities in Language Technology Performance across the World's Languages](<https://www.sota2.com/research/paper/68fa6af91e209131cea2b738>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-12-24T16:07:55.718Z

Authors: Dami\\'an Blasi, Antonios Anastasopoulos, Graham Neubig

Published: 2021-10-13T14:03:07.000Z

## Abstract

Natural language processing (NLP) systems have become a central technology in communication, education, medicine, artificial intelligence, and many other domains of research and development. While the performance of NLP methods has grown enormously over the last decade, this progress has been restricted to a minuscule subset of the world's 6,500 languages. We introduce a framework for estimating the global utility of language technologies as revealed in a comprehensive snapshot of recent publications in NLP. Our analyses involve the field at large, but also more in-depth studies on both user-facing technologies (machine translation, language understanding, question answering, text-to-speech synthesis) as well as more linguistic NLP tasks (dependency parsing, morphological inflection). In the process, we (1) quantify disparities in the current state of NLP research, (2) explore some of its associated societal and academic factors, and (3) produce tailored recommendations for evidence-based policy making aimed at promoting more global and equitable language technologies.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2110.06733>)

[PDF](<https://arxiv.org/pdf/2110.06733.pdf>)

[Implementation](<https://github.com/neubig/globalutility>)
