# Better Early than Late: Fusing Topics with Word Embeddings for Neural Question Paraphrase Identification

Source: [Better Early than Late: Fusing Topics with Word Embeddings for Neural Question Paraphrase Identification](<https://www.sota2.com/research/paper/68fa680c1e209131cea19cec>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:28:00.017Z

Authors: Nicole Peinelt, Dong Nguyen, Maria Liakata

Published: 2020-07-22T10:09:26.000Z

## Abstract

Question paraphrase identification is a key task in Community Question Answering (CQA) to determine if an incoming question has been previously asked. Many current models use word embeddings to identify duplicate questions, but the use of topic models in feature-engineered systems suggests that they can be helpful for this task, too. We therefore propose two ways of merging topics with word embeddings (early vs. late fusion) in a new neural architecture for question paraphrase identification. Our results show that our system outperforms neural baselines on multiple CQA datasets, while an ablation study highlights the importance of topics and especially early topic-embedding fusion in our architecture.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2007.11314>)

[PDF](<https://arxiv.org/pdf/2007.11314.pdf>)
