# Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic Knowledge

Source: [Facts as Experts: Adaptable and Interpretable Neural Memory over Symbolic Knowledge](<https://www.sota2.com/research/paper/68fa67d11e209131cea18a55>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:23:05.784Z

Authors: Pat Verga, Haitian Sun, Livio Baldini Soares, William W. Cohen

Published: 2020-07-02T03:05:41.000Z

## Abstract

Massive language models are the core of modern NLP modeling and have been shown to encode impressive amounts of commonsense and factual information. However, that knowledge exists only within the latent parameters of the model, inaccessible to inspection and interpretation, and even worse, factual information memorized from the training corpora is likely to become stale as the world changes. Knowledge stored as parameters will also inevitably exhibit all of the biases inherent in the source materials. To address these problems, we develop a neural language model that includes an explicit interface between symbolically interpretable factual information and subsymbolic neural knowledge. We show that this model dramatically improves performance on two knowledge-intensive question-answering tasks. More interestingly, the model can be updated without re-training by manipulating its symbolic representations. In particular this model allows us to add new facts and overwrite existing ones in ways that are not possible for earlier models.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2007.00849>)

[PDF](<https://arxiv.org/pdf/2007.00849.pdf>)
