# Computational Semantics and Evaluation Benchmark for Interrogative Sentences via Combinatory Categorial Grammar

Source: [Computational Semantics and Evaluation Benchmark for Interrogative Sentences via Combinatory Categorial Grammar](<https://www.sota2.com/research/paper/68fa71a91e209131cea52627>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T02:10:33.419Z

Authors: Hayate Funakura, Koji Mineshima

Published: 2023-12-22T14:46:02.000Z

## Abstract

We present a compositional semantics for various types of polar questions and wh-questions within the framework of Combinatory Categorial Grammar (CCG). To assess the explanatory power of our proposed analysis, we introduce a question-answering dataset QSEM specifically designed to evaluate the semantics of interrogative sentences. We implement our analysis using existing CCG parsers and conduct evaluations using the dataset. Through the evaluation, we have obtained annotated data with CCG trees and semantic representations for about half of the samples included in QSEM. Furthermore, we discuss the discrepancy between the theoretical capacity of CCG and the capabilities of existing CCG parsers.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2312.14737>)

[PDF](<https://arxiv.org/pdf/2312.14737.pdf>)
