Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Text-to-SQL research benchmarks – Page 6 · SOTA2 Research

Text-to-SQL

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Criteria-to-SQL (test)

YXJ + GAP MODEL

32.7SQL Accuracy

5

Feb 26, 2026

Spider2-Lite Snowflake v1.0 (test)

52.23Pass@1

4

May 22, 2026

Spider2-Lite SQLite v1.0 (test)

64.44Pass@1 Accuracy

4

May 22, 2026

Bird-Critic PostgreSQL

46.16Pass@1

4

May 22, 2026

BIRD hidden (test)

71.6Execution Accuracy

4

May 12, 2026

Spider Robustness Variants (SYN, REALISTIC, DK) (test)

76.9Accuracy (SYN)

4

May 12, 2026

85.78Execution Accuracy

4

May 12, 2026

Spider Lite 2.0 (test)

46.6Execution Accuracy (EX)

4

Apr 28, 2026

Spider lite 2.0 (Random 100 examples)

RSL-SQL + KaSLA

28Execution Accuracy (EX)

4

Apr 23, 2026

Spider 120 2018/2025 (test)

88.3SRR

4

Apr 3, 2026

77.5Pass@1

4

Mar 18, 2026

18.7Execution Accuracy (EX)

4

Mar 10, 2026

29.8Execution Accuracy (EX)

4

Mar 10, 2026

Spider (test dev)

0.717Execution Accuracy

4

Feb 26, 2026

SPIDER-SSP 1.0 (test)

70.1Template Match Rate

4

Feb 26, 2026

OmniSQL-Spider (test)

88.1Execution Accuracy (easy)

3

May 13, 2026

91.3Mean Score

3

May 1, 2026

BIRD-SQL StreamBench

53.5Accuracy (Simple)

3

Mar 31, 2026

Human Evaluation Subset (100 samples)

93CP

2

Jun 16, 2026

EHRSQL answerable 2024 (test)

Claude Sonnet 4

94Correct Answers

2

May 21, 2026

84.2AccEX

2

Mar 9, 2026

BIRD official (test)

RoboPhD (Best Evolved)

73.67Total Accuracy

2

Feb 26, 2026

74Accuracy (Easy)

2

Feb 26, 2026

91.08Accuracy (Easy)

2

Feb 26, 2026

Page 6 of 6

Popular datasets

Spider BIRD WikiSQL WTQ ATIS

Follow for updates

Join SOTA2 Contact