# ConditionalQA: A Complex Reading Comprehension Dataset with Conditional Answers

Source: [ConditionalQA: A Complex Reading Comprehension Dataset with Conditional Answers](<https://www.sota2.com/research/paper/68fa6b101e209131cea2be2b>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:39:16.015Z

Authors: Haitian Sun, William W. Cohen, Ruslan Salakhutdinov

Published: 2021-10-13T17:16:46.000Z

## Abstract

We describe a Question Answering (QA) dataset that contains complex questions with conditional answers, i.e. the answers are only applicable when certain conditions apply. We call this dataset ConditionalQA. In addition to conditional answers, the dataset also features: (1) long context documents with information that is related in logically complex ways; (2) multi-hop questions that require compositional logical reasoning; (3) a combination of extractive questions, yes/no questions, questions with multiple answers, and not-answerable questions; (4) questions asked without knowing the answers. We show that ConditionalQA is challenging for many of the existing QA models, especially in selecting answer conditions. We believe that this dataset will motivate further research in answering complex questions over long documents. Data and leaderboard are publicly available at \\url{https://github.com/haitian-sun/ConditionalQA}.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2110.06884>)

[PDF](<https://arxiv.org/pdf/2110.06884.pdf>)
