# Compositional Language Understanding with Text-based Relational Reasoning

Source: [Compositional Language Understanding with Text-based Relational Reasoning](<https://www.sota2.com/research/paper/68fa65001e209131cea07bf4>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:16:52.800Z

Authors: Koustuv Sinha, Shagun Sodhani, William L. Hamilton, Joelle Pineau

Published: 2018-11-07T16:17:48.000Z

## Abstract

Neural networks for natural language reasoning have largely focused on extractive, fact-based question-answering (QA) and common-sense inference. However, it is also crucial to understand the extent to which neural networks can perform relational reasoning and combinatorial generalization from natural language---abilities that are often obscured by annotation artifacts and the dominance of language modeling in standard QA benchmarks. In this work, we present a novel benchmark dataset for language understanding that isolates performance on relational reasoning. We also present a neural message-passing baseline and show that this model, which incorporates a relational inductive bias, is superior at combinatorial generalization compared to a traditional recurrent neural network approach.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1811.02959>)

[PDF](<https://arxiv.org/pdf/1811.02959.pdf>)
