# Artefact Retrieval: Overview of NLP Models with Knowledge Base Access

Source: [Artefact Retrieval: Overview of NLP Models with Knowledge Base Access](<https://www.sota2.com/research/paper/68fa6b9f1e209131cea2f5d4>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:53:05.688Z

Authors: Vil\\'em Zouhar, Marius Mosbach, Debanjali Biswas, Dietrich Klakow

Published: 2022-01-24T13:15:33.000Z

## Abstract

Many NLP models gain performance by having access to a knowledge base. A lot of research has been devoted to devising and improving the way the knowledge base is accessed and incorporated into the model, resulting in a number of mechanisms and pipelines. Despite the diversity of proposed mechanisms, there are patterns in the designs of such systems. In this paper, we systematically describe the typology of artefacts (items retrieved from a knowledge base), retrieval mechanisms and the way these artefacts are fused into the model. This further allows us to uncover combinations of design decisions that had not yet been tried. Most of the focus is given to language models, though we also show how question answering, fact-checking and knowledgable dialogue models fit into this system as well. Having an abstract model which can describe the architecture of specific models also helps with transferring these architectures between multiple NLP tasks.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2201.09651>)

[PDF](<https://arxiv.org/pdf/2201.09651.pdf>)
