Text-to-SQL Error Repairing on BIRD benchmark leaderboard · SOTA2 Research

Text-to-SQL Error Repairing on BIRD

119True Positive Repairs (EM)MapleDoctor

Evaluation Results

Method	Links
MapleDoctor2025.01		119	16
LLM-Value2025.01		117	56
LLM-Value2025.01		116	48
LLM-Exe2025.01		114	51
LLM-Extr2025.01		114	62
LLM-Exe2025.01		113	38
LLM-Plain2025.01		112	52
LLM-Value2025.01		109	37
LLM-Extr2025.01		106	56
LLM-Value2025.01		100	32
LLM-Exe2025.01		98	26
LLM-Plain2025.01		97	41
MapleDoctor2025.01		97	21
MapleDoctor2025.01		88	20
LLM-Extr2025.01		83	34
LLM-Plain2025.01		82	26
LLM-Exe2025.01		81	23
MapleDoctor2025.01		78	12
Rule-Exe2025.01		70	0
Rule-Exe2025.01		63	1
LLM-Extr2025.01		62	43
LLM-Plain2025.01		57	24
Rule-Exe2025.01		55	2
LLM-Exe2025.01		53	21
MapleDoctor2025.01		53	25
LLM-Value2025.01		52	34
Rule-Exe2025.01		51	0
LLM-Extr2025.01		50	26
LLM-Plain2025.01		47	24
Rule-Exe2025.01		29	6