Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Text-to-SQL research benchmarks – Page 3 · SOTA2 Research

Text-to-SQL

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Spider2-Lite BigQuery

62.07Pass@1

12

May 22, 2026

-0.11Kendall's τ

12

Apr 21, 2026

-0.5Kendall's Tau

12

Apr 21, 2026

-0.43Kendall's Tau

12

Apr 21, 2026

-0.78Kendall's τ

12

Apr 21, 2026

BMSQL-GPT-o3-mini

62.6Execution Accuracy (EX)

12

Mar 18, 2026

64.18AUPRC

12

Feb 26, 2026

4.24SR

12

Feb 26, 2026

WikiSQL Fully-supervised (test)

Guo & Gao w. GRAPPA (MLM+SSP)

90.8Execution Accuracy

12

Feb 26, 2026

WikiSQL Fully-supervised (dev)

Guo & Gao w. GRAPPA (MLM)

91.4Execution Accuracy

12

Feb 26, 2026

GEOQUERY template (test)

0.83Accuracy

12

Feb 26, 2026

ATIS template (test)

47.8Accuracy

12

Feb 26, 2026

Spider 1.0 (val)

Full Fine-tuning (All)

64.8Accuracy (All)

11

Feb 26, 2026

BIRD (holdout test)

73Execution Accuracy

11

Feb 26, 2026

Spider-Syn (dev)

SPR + ManualMAS

62.6Exact Match Accuracy

11

Feb 26, 2026

WikiSQL 4 (test)

74.6Execution Accuracy

11

Feb 26, 2026

WikiSQL 4 (dev)

75.1Execution Accuracy

11

Feb 26, 2026

BIRD In-Domain (dev)

70.7Accuracy (Simple)

10

Jul 3, 2026

Spider hidden (test)

S2SQL + ELECTRA

72.1Exact Match (EM)

10

Feb 26, 2026

Spider-DK 1.0 (val)

51.2EM

10

Feb 26, 2026

Spider-SYN 1.0 (val)

66.9EM Accuracy

10

Feb 26, 2026

Spider ADVETA-ADD

50.6Exact Match (EM)

10

Feb 26, 2026

Spider (ADVETA-RPL)

35.8Exact Match (EM)

10

Feb 26, 2026

Spider2-Snow 80-case

43.75Execution Accuracy

9

May 29, 2026

63.8Execution Accuracy (EX)

9

Apr 21, 2026

Page 3 of 6

Popular datasets

Spider BIRD WikiSQL WTQ ATIS

Follow for updates

Join SOTA2 Contact