Text-to-SQL on Spider2-Lite SQLite
62.59Pass@1 AccuracyCHASE-SQL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CHASE-SQLBackbone LLM=Opus 4.62026.05 | 62.59 | 76.3 | 63.7 | |
| CHASE-SQLModel=Opus 4.62026.05 | 62.59 | 76.3 | 63.7 | |
| DIVSKILL-SQLBackbone LLM=Opus 4.62026.05 | 62.13 | 73.33 | 64.44 | |
| DIVSKILL-SQLModel=Opus 4.62026.05 | 62.13 | 73.33 | 64.44 | |
| REFORCEBackbone LLM=Opus 4.62026.05 | 55.28 | — | 57.78 | |
| REFORCEModel=Opus 4.62026.05 | 55.28 | — | 57.78 | |
| DIN-SQLBackbone LLM=Opus 4.62026.05 | 40.74 | — | — | |
| DIN-SQLModel=Opus 4.62026.05 | 40.74 | — | — |