# LSTM-based Mixture-of-Experts for Knowledge-Aware Dialogues

Source: [LSTM-based Mixture-of-Experts for Knowledge-Aware Dialogues](<https://www.sota2.com/research/paper/68fa627f1e209131ce9f9a11>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-27T05:50:53.386Z

Authors: Phong Le, Marc Dymetman, Jean-Michel Renders

Published: 2016-05-05T17:00:44.000Z

## Abstract

We introduce an LSTM-based method for dynamically integrating several word-prediction experts to obtain a conditional language model which can be good simultaneously at several subtasks. We illustrate this general approach with an application to dialogue where we integrate a neural chat model, good at conversational aspects, with a neural question-answering model, good at retrieving precise information from a knowledge-base, and show how the integration combines the strengths of the independent components. We hope that this focused contribution will attract attention on the benefits of using such mixtures of experts in NLP.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1605.01652>)

[PDF](<https://arxiv.org/pdf/1605.01652.pdf>)
