# Learning Semantic Structure through First-Order-Logic Translation

Source: [Learning Semantic Structure through First-Order-Logic Translation](<https://www.sota2.com/research/paper/68fa751b1e209131cea65d0d>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T03:26:16.510Z

Authors: Akshay Chaturvedi, Nicholas Asher

Published: 2024-10-04T07:39:34.000Z

## Abstract

In this paper, we study whether transformer-based language models can extract predicate argument structure from simple sentences. We firstly show that language models sometimes confuse which predicates apply to which objects. To mitigate this, we explore two tasks: question answering (Q/A), and first order logic (FOL) translation, and two regimes, prompting and finetuning. In FOL translation, we finetune several large language models on synthetic datasets designed to gauge their generalization abilities. For Q/A, we finetune encoder models like BERT and RoBERTa and use prompting for LLMs. The results show that FOL translation for LLMs is better suited to learn predicate argument structure.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2410.03203>)

[PDF](<https://arxiv.org/pdf/2410.03203.pdf>)
