# UQuAD1.0: Development of an Urdu Question Answering Training Data for Machine Reading Comprehension

Source: [UQuAD1.0: Development of an Urdu Question Answering Training Data for Machine Reading Comprehension](<https://www.sota2.com/research/paper/68fa6b291e209131cea2c699>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-12-14T18:06:49.868Z

Authors: Samreen Kazi, Shakeel Khoja (1) \_\_INSTITUTION\_2\_\_ School of Mathematics & Computer Science, Institute of Business Administration, Karachi Pakistan)

Published: 2021-11-02T12:25:04.000Z

## Abstract

In recent years, low-resource Machine Reading Comprehension (MRC) has made significant progress, with models getting remarkable performance on various language datasets. However, none of these models have been customized for the Urdu language. This work explores the semi-automated creation of the Urdu Question Answering Dataset (UQuAD1.0) by combining machine-translated SQuAD with human-generated samples derived from Wikipedia articles and Urdu RC worksheets from Cambridge O-level books. UQuAD1.0 is a large-scale Urdu dataset intended for extractive machine reading comprehension tasks consisting of 49k question Answers pairs in question, passage, and answer format. In UQuAD1.0, 45000 pairs of QA were generated by machine translation of the original SQuAD1.0 and approximately 4000 pairs via crowdsourcing. In this study, we used two types of MRC models: rule-based baseline and advanced Transformer-based models. However, we have discovered that the latter outperforms the others; thus, we have decided to concentrate solely on Transformer-based architectures. Using XLMRoBERTa and multi-lingual BERT, we acquire an F1 score of 0.66 and 0.63, respectively.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2111.01543>)

[PDF](<https://arxiv.org/pdf/2111.01543.pdf>)