Text-to-SQL on BIRD (holdout test)
73Execution AccuracyCHASE-SQL
Evaluation Results
| Method | Links | |
|---|---|---|
| CHASE-SQLMethod category=Published, Backbone=Gemini 1.52024.10 | 73 | |
| AskDataMethod category=Undisclosed, Backbone=GPT-4o2024.10 | 72.39 | |
| OpenSearch-v2Method category=Undisclosed, Backbone=GPT-4o2024.10 | 72.28 | |
| DistilleryMethod category=Published, Backbone=GPT-4o2024.10 | 71.83 | |
| Insights AIMethod category=Undisclosed2024.10 | 70.26 | |
| PURPLE-REDMethod category=Undisclosed, Backbone=GPT-4o2024.10 | 70.21 | |
| ExSLMethod category=Undisclosed, Backbone=granite-34b-code2024.10 | 67.76 | |
| CHESSMethod category=Published2024.10 | 66.69 | |
| ArcwiseMethod category=Undisclosed, Backbone=GPT-4o2024.10 | 66.21 | |
| MCS-SQLMethod category=Published, Backbone=GPT-42024.10 | 65.45 | |
| SuperSQLMethod category=Published2024.10 | 62.66 |