Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

BIRD dataset and benchmarks – Page 3 · SOTA2 Research

Research Datasets

BIRD

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

BIRD

100Recall (R)

6

Table Retrieval

BIRD

90.1Recall@5

6

End-to-end Question Answering

Bird

20.6Accuracy

6

Cross-dialect Text-to-SQL evaluation fidelity

BIRD

100Coverage

5

BIRD

0Cost Per Query

5

Label-free Performance Estimation

BIRD

9.2MAE (ATHENA)

5

Object Detection

Bird

94.9Accuracy

5

BIRD Route

79.62R@1

5

Bird

43.83Pass@1

5

BIRD-Interact

55.7Task Success Rate

4

BIRD (dev)

77.8Execution Accuracy

4

Text-to-SQL Error Repair

BIRD

127Original Pipeline Repair Count

4

BIRD hidden (test)

71.6Execution Accuracy

4

Text-to-SQL Data Synthesis

BIRD Many Columns (train)

3,823.7Token Cost (1k)

3

Text-to-SQL Data Synthesis

BIRD Medium Columns (train)

1,324.1Token Cost (1k Tokens)

3

Text-to-SQL Data Synthesis

BIRD Few Columns (train)

581.4Token Cost (1k)

3

BIRD

72Accuracy

3

Text-to-SQL Generation

BIRD 96 questions (subset)

93.8Execution Accuracy

2

BIRD official (test)

73.67Total Accuracy

2

Gram matrix computation

Bird

—Primary metric

0

Page 3 of 3

Popular tasks

Text-to-SQL Table Retrieval Text2SQL SQL Generation Text-to-SQL Data Synthesis

Follow for updates

Join SOTA2 Contact