Text-to-SQL Error Repairing on Spider benchmark leaderboard · SOTA2 Research

Text-to-SQL Error Repairing on Spider

116True Positive Repairs (EM)LLM-Value

Evaluation Results

Method	Links
LLM-Value2025.01		116	70
LLM-Exe2025.01		110	60
LLM-Extr2025.01		100	127
LLM-Extr2025.01		90	73
LLM-Plain2025.01		86	58
LLM-Extr2025.01		85	146
LLM-Extr2025.01		83	35
LLM-Exe2025.01		81	33
LLM-Plain2025.01		81	141
LLM-Exe2025.01		80	48
LLM-Value2025.01		80	47
LLM-Value2025.01		76	31
LLM-Plain2025.01		76	69
LLM-Plain2025.01		74	33
LLM-Exe2025.01		73	139
LLM-Value2025.01		71	134
MapleDoctor2025.01		68	5
LLM-Extr2025.01		68	45
MapleDoctor2025.01		65	5
LLM-Plain2025.01		63	38
MapleDoctor2025.01		61	2
MapleDoctor2025.01		59	15
LLM-Value2025.01		57	45
Rule-Exe2025.01		53	1
LLM-Exe2025.01		52	41
MapleDoctor2025.01		46	7
Rule-Exe2025.01		23	2
Rule-Exe2025.01		23	0
Rule-Exe2025.01		13	1
Rule-Exe2025.01		13	3