Text-to-SQL on Spider SmBoP parser outputs (dev)
78EMCodeT5
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CodeT5Query=PyDict, Edit=Program2023.05 | 78 | 78.5 | |
| CodeT5Query=PyDict, Edit=Clause-Level2023.05 | 77.3 | 77.8 | |
| CodeT5*Query=PyDict, Edit=Program, Note=Fine-tuned to generate edit programs only2023.05 | 77.3 | 77.6 | |
| CodeT5Query=SQL, Edit=Clause-Level2023.05 | 76.7 | 77.4 | |
| CoditT5Query=SQL, Edit=Clause-Level2023.05 | 76.3 | 77.2 | |
| CoditT5Query=PyDict, Edit=Clause-Level2023.05 | 76.3 | 77 | |
| CodeT5Query=SQL, Edit=Token-Level2023.05 | 75.6 | 76.5 | |
| No EditQuery=N/A, Edit=N/A2023.05 | 74.6 | 75.3 | |
| CoditT5Query=SQL, Edit=Token-Level2023.05 | 74.2 | 75.3 |