# Incremental Natural Language Processing: Challenges, Strategies, and Evaluation

Source: [Incremental Natural Language Processing: Challenges, Strategies, and Evaluation](<https://www.sota2.com/research/paper/68fa64821e209131cea04fe0>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:06:03.000Z

Authors: Arne K\\"ohn

Published: 2018-05-31T15:29:32.000Z

## Abstract

Incrementality is ubiquitous in human-human interaction and beneficial for human-computer interaction. It has been a topic of research in different parts of the NLP community, mostly with focus on the specific topic at hand even though incremental systems have to deal with similar challenges regardless of domain. In this survey, I consolidate and categorize the approaches, identifying similarities and differences in the computation and data, and show trade-offs that have to be considered. A focus lies on evaluating incremental systems because the standard metrics often fail to capture the incremental properties of a system and coming up with a suitable evaluation scheme is non-trivial.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1805.12518>)

[PDF](<https://arxiv.org/pdf/1805.12518.pdf>)
