# BRENT: Bidirectional Retrieval Enhanced Norwegian Transformer Source: [BRENT: Bidirectional Retrieval Enhanced Norwegian Transformer]() Collection index: [llms.txt]() Data updated: 2025-10-27T06:22:26.632Z Authors: Lucas Georges Gabriel Charpentier, Sondre Wold, David Samuel, Egil R{\\o}nningstad Published: 2023-04-19T13:40:47.000Z ## Abstract Retrieval-based language models are increasingly employed in question-answering tasks. These models search in a corpus of documents for relevant information instead of having all factual knowledge stored in its parameters, thereby enhancing efficiency, transparency, and adaptability. We develop the first Norwegian retrieval-based model by adapting the REALM framework and evaluating it on various tasks. After training, we also separate the language model, which we call the reader, from the retriever components, and show that this can be fine-tuned on a range of downstream tasks. Results show that retrieval augmented language modeling improves the reader's performance on extractive question-answering, suggesting that this type of training improves language models' general ability to use context and that this does not happen at the expense of other abilities such as part-of-speech tagging, dependency parsing, named entity recognition, and lemmatization. Code, trained models, and data are made publicly available. ## Recorded benchmark results A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. ## Original sources and implementation [Original paper]() [PDF]()