Text-to-SQL Error Repair on Spider
55Original Pipeline RepairsMapleDoctor
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| MapleDoctorTechnique=CHESS, LLM=GPT-3.52025.01 | 55 | 2 | 53 | 76 | 4 | 72 | 19 | |
| MapleDoctorTechnique=DIN-SQL, LLM=GPT-3.52025.01 | 38 | 37 | 1 | 66 | 2 | 64 | 63 | |
| MapleDoctorTechnique=DEA-SQL, LLM=GPT-3.52025.01 | 25 | 64 | -39 | 34 | 4 | 30 | 69 | |
| MapleDoctorTechnique=MAC-SQL, LLM=GPT-3.52025.01 | 11 | 0 | 11 | 46 | 2 | 44 | 33 | |
| MapleDoctorTechnique=DEA-SQL, LLM=GPT-4o2025.01 | 8 | 16 | -8 | 11 | 6 | 5 | 13 | |
| MapleDoctorTechnique=MAC-SQL, LLM=GPT-4o2025.01 | 0 | 0 | 0 | 29 | 10 | 19 | 19 |