Dataset-level accuracy estimation on WikiSQL to Spider
3.2MAEFusionSQL
Evaluation Results
| Method | Links | |
|---|---|---|
| FusionSQLModel=Qwen2.5-72B2026.03 | 3.2 | |
| FusionSQL-TLModel=Qwen2.5-72B2026.03 | 3.6 | |
| FusionSQLModel=Llama-3.1-70B2026.03 | 3.8 | |
| FusionSQL-TLModel=Llama-3.1-70B2026.03 | 4.1 | |
| FusionSQLModel=Avg.2026.03 | 4.2 | |
| FusionSQLModel=DeepSeek-33B2026.03 | 4.3 | |
| FusionSQL-TLModel=Avg.2026.03 | 4.6 | |
| FusionSQL-TLModel=DeepSeek-33B2026.03 | 4.7 | |
| FusionSQLModel=XiYanSQL-14B2026.03 | 4.7 | |
| FusionSQL-TLModel=XiYanSQL-14B2026.03 | 5.1 | |
| FusionSQLModel=CSC-SQL-7B2026.03 | 5.2 | |
| FusionSQL-TLModel=CSC-SQL-7B2026.03 | 5.6 | |
| ArenaCmpModel=Qwen2.5-72B2026.03 | 9.2 | |
| ArenaCmpModel=Llama-3.1-70B2026.03 | 9.9 | |
| ArenaCmpModel=DeepSeek-33B2026.03 | 10.7 | |
| ArenaCmpModel=Avg.2026.03 | 10.9 | |
| PseAutoEvalModel=Qwen2.5-72B2026.03 | 11.1 | |
| PseAutoEvalModel=Llama-3.1-70B2026.03 | 11.8 | |
| ArenaCmpModel=XiYanSQL-14B2026.03 | 12 | |
| ATC-MCModel=Qwen2.5-72B2026.03 | 12.2 | |
| PseAutoEvalModel=DeepSeek-33B2026.03 | 12.6 | |
| PseAutoEvalModel=Avg.2026.03 | 12.8 | |
| ArenaCmpModel=CSC-SQL-7B2026.03 | 12.8 | |
| ATC-MCModel=Llama-3.1-70B2026.03 | 13.1 | |
| ATC-NEModel=Qwen2.5-72B2026.03 | 13.4 | |
| BugJudgeModel=Qwen2.5-72B2026.03 | 13.6 | |
| PseAutoEvalModel=XiYanSQL-14B2026.03 | 13.7 | |
| ATC-MCModel=DeepSeek-33B2026.03 | 13.8 | |
| ATC-NEModel=Llama-3.1-70B2026.03 | 14 | |
| ATC-MCModel=Avg.2026.03 | 14.1 | |
| BugJudgeModel=Llama-3.1-70B2026.03 | 14.2 | |
| DoC (τ=0.8)Model=Qwen2.5-72B2026.03 | 14.6 | |
| PseAutoEvalModel=CSC-SQL-7B2026.03 | 14.9 | |
| ATC-NEModel=DeepSeek-33B2026.03 | 15.1 | |
| BugJudgeModel=DeepSeek-33B2026.03 | 15.1 | |
| ATC-MCModel=XiYanSQL-14B2026.03 | 15.2 | |
| ATC-NEModel=Avg.2026.03 | 15.3 | |
| DoC (τ=0.8)Model=Llama-3.1-70B2026.03 | 15.3 | |
| BugJudgeModel=Avg.2026.03 | 15.4 | |
| DoC (τ=0.9)Model=Qwen2.5-72B2026.03 | 15.8 | |
| ATC-MCModel=CSC-SQL-7B2026.03 | 16.1 | |
| ATC-NEModel=XiYanSQL-14B2026.03 | 16.3 | |
| DoC (τ=0.9)Model=Llama-3.1-70B2026.03 | 16.4 | |
| DoC (τ=0.8)Model=DeepSeek-33B2026.03 | 16.5 | |
| BugJudgeModel=XiYanSQL-14B2026.03 | 16.5 | |
| DoC (τ=0.8)Model=Avg.2026.03 | 16.6 | |
| ATC-NEModel=CSC-SQL-7B2026.03 | 17.5 | |
| BugJudgeModel=CSC-SQL-7B2026.03 | 17.6 | |
| DoC (τ=0.9)Model=DeepSeek-33B2026.03 | 17.7 | |
| DoC (τ=0.8)Model=XiYanSQL-14B2026.03 | 17.8 | |
| DoC (τ=0.9)Model=Avg.2026.03 | 17.9 | |
| DoC (τ=0.8)Model=CSC-SQL-7B2026.03 | 19 | |
| DoC (τ=0.9)Model=XiYanSQL-14B2026.03 | 19.1 | |
| DoC (τ=0.9)Model=CSC-SQL-7B2026.03 | 20.3 |