Dataset-level accuracy estimation on WikiSQL to Spider 2.0
4.2MAEFusionSQL
Evaluation results
| Method | Links | |
|---|---|---|
| FusionSQLModel=Qwen2.5-72B2026.03 | 4.2 | |
| FusionSQL-TLModel=Qwen2.5-72B2026.03 | 4.5 | |
| FusionSQLModel=Llama-3.1-70B2026.03 | 4.8 | |
| FusionSQL-TLModel=Llama-3.1-70B2026.03 | 5.1 | |
| FusionSQLModel=DeepSeek-33B2026.03 | 5.3 | |
| FusionSQLModel=Avg.2026.03 | 5.3 | |
| FusionSQL-TLModel=DeepSeek-33B2026.03 | 5.6 | |
| FusionSQL-TLModel=Avg.2026.03 | 5.6 | |
| FusionSQLModel=XiYanSQL-14B2026.03 | 5.8 | |
| FusionSQL-TLModel=XiYanSQL-14B2026.03 | 6.1 | |
| FusionSQLModel=CSC-SQL-7B2026.03 | 6.3 | |
| FusionSQL-TLModel=CSC-SQL-7B2026.03 | 6.6 | |
| ArenaCmpModel=Qwen2.5-72B2026.03 | 12.6 | |
| ArenaCmpModel=Llama-3.1-70B2026.03 | 13.4 | |
| ArenaCmpModel=DeepSeek-33B2026.03 | 14.5 | |
| ArenaCmpModel=Avg.2026.03 | 14.6 | |
| ArenaCmpModel=XiYanSQL-14B2026.03 | 15.8 | |
| PseAutoEvalModel=Qwen2.5-72B2026.03 | 16.3 | |
| ArenaCmpModel=CSC-SQL-7B2026.03 | 16.9 | |
| PseAutoEvalModel=Llama-3.1-70B2026.03 | 17 | |
| BugJudgeModel=Qwen2.5-72B2026.03 | 17.3 | |
| PseAutoEvalModel=DeepSeek-33B2026.03 | 17.7 | |
| ATC-MCModel=Qwen2.5-72B2026.03 | 18 | |
| PseAutoEvalModel=Avg.2026.03 | 18 | |
| BugJudgeModel=Llama-3.1-70B2026.03 | 18.1 | |
| ATC-MCModel=Llama-3.1-70B2026.03 | 18.7 | |
| PseAutoEvalModel=XiYanSQL-14B2026.03 | 18.8 | |
| BugJudgeModel=DeepSeek-33B2026.03 | 19.3 | |
| ATC-NEModel=Qwen2.5-72B2026.03 | 19.4 | |
| BugJudgeModel=Avg.2026.03 | 19.5 | |
| ATC-MCModel=DeepSeek-33B2026.03 | 19.6 | |
| ATC-MCModel=Avg.2026.03 | 19.9 | |
| ATC-NEModel=Llama-3.1-70B2026.03 | 20.1 | |
| PseAutoEvalModel=CSC-SQL-7B2026.03 | 20.1 | |
| DoC (τ=0.8)Model=Qwen2.5-72B2026.03 | 20.5 | |
| BugJudgeModel=XiYanSQL-14B2026.03 | 20.7 | |
| ATC-MCModel=XiYanSQL-14B2026.03 | 21 | |
| ATC-NEModel=DeepSeek-33B2026.03 | 21.3 | |
| DoC (τ=0.8)Model=Llama-3.1-70B2026.03 | 21.3 | |
| ATC-NEModel=Avg.2026.03 | 21.5 | |
| DoC (τ=0.9)Model=Qwen2.5-72B2026.03 | 21.7 | |
| BugJudgeModel=CSC-SQL-7B2026.03 | 22 | |
| ATC-MCModel=CSC-SQL-7B2026.03 | 22.2 | |
| DoC (τ=0.9)Model=Llama-3.1-70B2026.03 | 22.5 | |
| ATC-NEModel=XiYanSQL-14B2026.03 | 22.6 | |
| DoC (τ=0.8)Model=DeepSeek-33B2026.03 | 22.7 | |
| DoC (τ=0.8)Model=Avg.2026.03 | 22.8 | |
| ATC-NEModel=CSC-SQL-7B2026.03 | 23.9 | |
| DoC (τ=0.9)Model=DeepSeek-33B2026.03 | 23.9 | |
| DoC (τ=0.9)Model=Avg.2026.03 | 23.9 | |
| DoC (τ=0.8)Model=XiYanSQL-14B2026.03 | 24 | |
| DoC (τ=0.9)Model=XiYanSQL-14B2026.03 | 25.2 | |
| DoC (τ=0.8)Model=CSC-SQL-7B2026.03 | 25.4 | |
| DoC (τ=0.9)Model=CSC-SQL-7B2026.03 | 26.6 |