Text-to-SQL Error Repairing on Spider
116True Positive Repairs (EM)LLM-Value
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LLM-ValueLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 116 | 70 | |
| LLM-ExeLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 110 | 60 | |
| LLM-ExtrLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 100 | 127 | |
| LLM-ExtrLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 90 | 73 | |
| LLM-PlainLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 86 | 58 | |
| LLM-ExtrLLM=Mistral, Base Framework=MAC-SQL2025.01 | 85 | 146 | |
| LLM-ExtrLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 83 | 35 | |
| LLM-ExeLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 81 | 33 | |
| LLM-PlainLLM=Mistral, Base Framework=MAC-SQL2025.01 | 81 | 141 | |
| LLM-ExeLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 80 | 48 | |
| LLM-ValueLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 80 | 47 | |
| LLM-ValueLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 76 | 31 | |
| LLM-PlainLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 76 | 69 | |
| LLM-PlainLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 74 | 33 | |
| LLM-ExeLLM=Mistral, Base Framework=MAC-SQL2025.01 | 73 | 139 | |
| LLM-ValueLLM=Mistral, Base Framework=MAC-SQL2025.01 | 71 | 134 | |
| MapleDoctorLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 68 | 5 | |
| LLM-ExtrLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 68 | 45 | |
| MapleDoctorLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 65 | 5 | |
| LLM-PlainLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 63 | 38 | |
| MapleDoctorLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 61 | 2 | |
| MapleDoctorLLM=Mistral, Base Framework=MAC-SQL2025.01 | 59 | 15 | |
| LLM-ValueLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 57 | 45 | |
| Rule-ExeLLM=LLaMA, Base Framework=MAC-SQL2025.01 | 53 | 1 | |
| LLM-ExeLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 52 | 41 | |
| MapleDoctorLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 46 | 7 | |
| Rule-ExeLLM=GPT-3.5, Base Framework=MAC-SQL2025.01 | 23 | 2 | |
| Rule-ExeLLM=DSCoder, Base Framework=MAC-SQL2025.01 | 23 | 0 | |
| Rule-ExeLLM=Qwen3, Base Framework=MAC-SQL2025.01 | 13 | 1 | |
| Rule-ExeLLM=Mistral, Base Framework=MAC-SQL2025.01 | 13 | 3 |