Text-to-SQL Error Repair on BIRD (Pipeline Comparison Metrics)
127Original Pipeline Repair CountMapleDoctor
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| MapleDoctorTechnique=CHESS, LLM=GPT-3.52025.01 | 127 | 11 | 116 | 151 | 11 | 140 | 24 | |
| MapleDoctorTechnique=MAC-SQL, LLM=GPT-3.52025.01 | 75 | 6 | 69 | 131 | 8 | 123 | 54 | |
| MapleDoctorTechnique=DIN-SQL, LLM=GPT-3.52025.01 | 61 | 113 | -52 | 118 | 15 | 103 | 155 | |
| MapleDoctorTechnique=MAC-SQL, LLM=GPT-4o2025.01 | 24 | 1 | 23 | 65 | 13 | 52 | 29 |