Text-to-SQL on Spider CodeT5 parser outputs (dev)
69.2EMCodeT5*
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CodeT5*Query=PyDict, Edit=Program, Note=Fine-tuned to generate edit programs only2023.05 | 69.2 | 68.4 | |
| CodeT5Query=PyDict, Edit=Program2023.05 | 69 | 68.2 | |
| CodeT5Query=SQL, Edit=Clause-Level2023.05 | 68.3 | 68.2 | |
| CoditT5Query=PyDict, Edit=Clause-Level2023.05 | 67.1 | 66.5 | |
| CoditT5Query=SQL, Edit=Clause-Level2023.05 | 67 | 65.4 | |
| CodeT5Query=SQL, Edit=Token-Level2023.05 | 66.7 | 65.9 | |
| CodeT5Query=PyDict, Edit=Clause-Level2023.05 | 66.6 | 67.1 | |
| CoditT5Query=SQL, Edit=Token-Level2023.05 | 64.3 | 64.4 | |
| No EditQuery=N/A, Edit=N/A2023.05 | 62.7 | 63.6 |