Text-to-SQL on Spider BRIDGEv2 parser outputs (dev)
72.5EMCodeT5*
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CodeT5*Query=PyDict, Edit=Program, Note=Fine-tuned to generate edit programs only2023.05 | 72.5 | 73.1 | |
| CodeT5Query=PyDict, Edit=Program2023.05 | 72.5 | 73 | |
| CodeT5Query=PyDict, Edit=Clause-Level2023.05 | 72 | 72.4 | |
| CodeT5Query=SQL, Edit=Clause-Level2023.05 | 71.8 | 72.5 | |
| CoditT5Query=SQL, Edit=Clause-Level2023.05 | 71.3 | 70.9 | |
| CoditT5Query=PyDict, Edit=Clause-Level2023.05 | 70.6 | 70.8 | |
| No EditQuery=N/A, Edit=N/A2023.05 | 70.1 | 68.2 | |
| CodeT5Query=SQL, Edit=Token-Level2023.05 | 68.2 | 69.4 | |
| CoditT5Query=SQL, Edit=Token-Level2023.05 | 65.4 | 66.6 |