NorBench -- A Benchmark for Norwegian Language Models

We present NorBench: a streamlined suite of NLP tasks and probes for evaluating Norwegian language models (LMs) on standardized data splits and evaluation metrics. We also introduce a range of new Norwegian language models (both encoder and encoder-decoder based). Finally, we compare and analyze their performance, along with other existing LMs, across the different benchmark tests of NorBench.

David Samuel, Andrey Kutuzov, Samia Touileb, Erik Velldal, Lilja \Ovrelid, Egil R\onningstad, Elina Sigdel, Anna Palatkina · 2023