# Cheaper, Better, Faster, Stronger: Robust Text-to-SQL without Chain-of-Thought or Fine-Tuning

Source: [Cheaper, Better, Faster, Stronger: Robust Text-to-SQL without Chain-of-Thought or Fine-Tuning](<https://www.sota2.com/research/paper/68fa78ab1e209131cea79c5f>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-30T05:00:04.703Z

Authors: Yusuf Denizay D\\"onder, Derek Hommel, Andrea W Wen-Yi, David Mimno, Unso Eun Seo Jo

Published: 2025-05-20T10:28:46.000Z

## Abstract

LLMs are effective at code generation tasks like text-to-SQL, but is it worth the cost? Many state-of-the-art approaches use non-task-specific LLM techniques including Chain-of-Thought (CoT), self-consistency, and fine-tuning. These methods can be costly at inference time, sometimes requiring over a hundred LLM calls with reasoning, incurring average costs of up to \\$0.46 per query, while fine-tuning models can cost thousands of dollars. We introduce "N-rep" consistency, a more cost-efficient text-to-SQL approach that achieves similar BIRD benchmark scores as other more expensive methods, at only \\$0.039 per query. N-rep leverages multiple representations of the same schema input to mitigate weaknesses in any single representation, making the solution more robust and allowing the use of smaller and cheaper models without any reasoning or fine-tuning. To our knowledge, N-rep is the best-performing text-to-SQL approach in its cost range.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Text-to-SQL on Spider (test)](<https://www.sota2.com/research/sota/text-to-sql-on-spider-test.md>): Text-to-SQL; Spider (test); Execution Accuracy: 87.

- [Text-to-SQL on BIRD (dev)](<https://www.sota2.com/research/sota/text-to-sql-on-bird-dev.md>): Text-to-SQL; BIRD (dev); Execution Accuracy (EA): 69.25.

- [Text-to-SQL on Spider (dev)](<https://www.sota2.com/research/sota/text-to-sql-on-spider-dev.md>): Text-to-SQL; Spider (dev); EX: 81.93.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2505.14174>)

[PDF](<https://arxiv.org/pdf/2505.14174.pdf>)
