# Enhance Long Text Understanding via Distilled Gist Detector from Abstractive Summarization

Source: [Enhance Long Text Understanding via Distilled Gist Detector from Abstractive Summarization](<https://www.sota2.com/research/paper/68fa6afe1e209131cea2b977>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:38:16.503Z

Authors: Yan Liu, Yazheng Yang

Published: 2021-10-10T09:21:24.000Z

## Abstract

Long text understanding is important yet challenging in natural language processing. A long article or essay usually contains many redundant words that are not pertinent to its gist and sometimes can be regarded as noise. In this paper, we consider the problem of how to disentangle the gist-relevant and irrelevant information for long text understanding. With distillation mechanism, we transfer the knowledge about how to focus the salient parts from the abstractive summarization model and further integrate the distilled model, named \\emph{Gist Detector}, into existing models as a supplementary component to augment the long text understanding. Experiments on document classification, distantly supervised open-domain question answering (DS-QA) and non-parallel text style transfer show that our method can significantly improve the performance of the baseline models, and achieves state-of-the-art overall results for document classification.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2110.04741>)

[PDF](<https://arxiv.org/pdf/2110.04741.pdf>)
