# A Collection of Question Answering Datasets for Norwegian

Source: [A Collection of Question Answering Datasets for Norwegian](<https://www.sota2.com/research/paper/68fa76b01e209131cea6e791>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T06:45:57.319Z

Authors: Vladislav Mikhailov, Petter M{\\ae}hlum, Victoria Ovedie Chruickshank Lang{\\o}, Erik Velldal, Lilja {\\O}vrelid

Published: 2025-01-19T17:42:48.000Z

## Abstract

This paper introduces a new suite of question answering datasets for Norwegian; NorOpenBookQA, NorCommonSenseQA, NorTruthfulQA, and NRK-Quiz-QA. The data covers a wide range of skills and knowledge domains, including world knowledge, commonsense reasoning, truthfulness, and knowledge about Norway. Covering both of the written standards of Norwegian - Bokm{\\aa}l and Nynorsk - our datasets comprise over 10k question-answer pairs, created by native speakers. We detail our dataset creation approach and present the results of evaluating 11 language models (LMs) in zero- and few-shot regimes. Most LMs perform better in Bokm{\\aa}l than Nynorsk, struggle most with commonsense reasoning, and are often untruthful in generating answers to questions. All our datasets and annotation materials are publicly available.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2501.11128>)

[PDF](<https://arxiv.org/pdf/2501.11128.pdf>)