Text-to-SQL Error Repairing on BIRD
119True Positive Repairs (EM)MapleDoctor
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MapleDoctorLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 119 | 16 | |
| LLM-ValueLLM=Mistral, Base Framework=MAC-SQL2025.01 | 117 | 56 | |
| LLM-ValueLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 116 | 48 | |
| LLM-ExeLLM=Mistral, Base Framework=MAC-SQL2025.01 | 114 | 51 | |
| LLM-ExtrLLM=Mistral, Base Framework=MAC-SQL2025.01 | 114 | 62 | |
| LLM-ExeLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 113 | 38 | |
| LLM-PlainLLM=Mistral, Base Framework=MAC-SQL2025.01 | 112 | 52 | |
| LLM-ValueLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 109 | 37 | |
| LLM-ExtrLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 106 | 56 | |
| LLM-ValueLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 100 | 32 | |
| LLM-ExeLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 98 | 26 | |
| LLM-PlainLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 97 | 41 | |
| MapleDoctorLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 97 | 21 | |
| MapleDoctorLLM=Mistral, Base Framework=MAC-SQL2025.01 | 88 | 20 | |
| LLM-ExtrLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 83 | 34 | |
| LLM-PlainLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 82 | 26 | |
| LLM-ExeLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 81 | 23 | |
| MapleDoctorLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 78 | 12 | |
| Rule-ExeLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 70 | 0 | |
| Rule-ExeLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 63 | 1 | |
| LLM-ExtrLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 62 | 43 | |
| LLM-PlainLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 57 | 24 | |
| Rule-ExeLLM=Mistral, Base Framework=MAC-SQL2025.01 | 55 | 2 | |
| LLM-ExeLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 53 | 21 | |
| MapleDoctorLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 53 | 25 | |
| LLM-ValueLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 52 | 34 | |
| Rule-ExeLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 51 | 0 | |
| LLM-ExtrLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 50 | 26 | |
| LLM-PlainLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 47 | 24 | |
| Rule-ExeLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 29 | 6 |