# MRT at SemEval-2025 Task 8: Maximizing Recovery from Tables with Multiple Steps

Source: [MRT at SemEval-2025 Task 8: Maximizing Recovery from Tables with Multiple Steps](<https://www.sota2.com/research/paper/68fa78d81e209131cea7ac1e>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-26T04:48:03.370Z

Authors: Maximiliano Hormaz\\'abal Lagos, \\'Alvaro Bueno Saez, H\\'ector Cerezo-Costas, Pedro Alonso Doval, Jorge Alcalde Vesteiro

Published: 2025-05-28T11:50:22.000Z

## Abstract

In this paper we expose our approach to solve the \\textit{SemEval 2025 Task 8: Question-Answering over Tabular Data} challenge. Our strategy leverages Python code generation with LLMs to interact with the table and get the answer to the questions. The process is composed of multiple steps: understanding the content of the table, generating natural language instructions in the form of steps to follow in order to get the answer, translating these instructions to code, running it and handling potential errors or exceptions. These steps use open source LLMs and fine grained optimized prompts for each task (step). With this approach, we achieved a score of $70.50\\%$ for subtask 1.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2505.22264>)

[PDF](<https://arxiv.org/pdf/2505.22264.pdf>)
