Project completion on Spider2-DBT
37.5Database Match AccuracyDIA
Evaluation results
| Method | Links | |
|---|---|---|
| DIADialect=DuckDB2026.06 | 37.5 | |
| Spider-Agent-DBTDialect=DuckDB, LLM=GPT-5.42026.06 | 35.3 | |
| Spider-AgentDialect=DuckDB, LLM=Claude 3.7 Sonnet2026.06 | 14.7 | |
| Spider-AgentDialect=DuckDB, LLM=o1-preview2026.06 | 13.2 |