# Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMs

Source: [Tables as Texts or Images: Evaluating the Table Reasoning Ability of LLMs and MLLMs](<https://www.sota2.com/research/paper/68fa75401e209131cea66d25>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-01-02T07:30:03.051Z

Authors: Naihao Deng, Zhenjie Sun, Ruiqi He, Aman Sikka, Yulong Chen, Lin Ma, Yue Zhang, Rada Mihalcea

Published: 2024-02-19T16:34:50.000Z

## Abstract

In this paper, we investigate the effectiveness of various LLMs in interpreting tabular data through different prompting strategies and data formats. Our analyses extend across six benchmarks for table-related tasks such as question-answering and fact-checking. We introduce for the first time the assessment of LLMs' performance on image-based table representations. Specifically, we compare five text-based and three image-based table representations, demonstrating the role of representation and prompting on LLM performance. Our study provides insights into the effective use of LLMs on table-related tasks.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2402.12424>)

[PDF](<https://arxiv.org/pdf/2402.12424.pdf>)

[Implementation](<https://huggingface.co/meta-llama/Llama-2-70b-chat>)
