# The Shmoop Corpus: A Dataset of Stories with Loosely Aligned Summaries

Source: [The Shmoop Corpus: A Dataset of Stories with Loosely Aligned Summaries](<https://www.sota2.com/research/paper/68fa66e61e209131cea1302a>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T22:01:21.007Z

Authors: Atef Chaudhury, Makarand Tapaswi, Seung Wook Kim, Sanja Fidler

Published: 2019-12-30T21:03:59.000Z

## Abstract

Understanding stories is a challenging reading comprehension problem for machines as it requires reading a large volume of text and following long-range dependencies. In this paper, we introduce the Shmoop Corpus: a dataset of 231 stories that are paired with detailed multi-paragraph summaries for each individual chapter (7,234 chapters), where the summary is chronologically aligned with respect to the story chapter. From the corpus, we construct a set of common NLP tasks, including Cloze-form question answering and a simplified form of abstractive summarization, as benchmarks for reading comprehension on stories. We then show that the chronological alignment provides a strong supervisory signal that learning-based methods can exploit leading to significant improvements on these tasks. We believe that the unique structure of this corpus provides an important foothold towards making machine story comprehension more approachable.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1912.13082>)

[PDF](<https://arxiv.org/pdf/1912.13082.pdf>)
