Dataset-level accuracy estimation on SParC to CoSQL
1.5MAEFusionSQL-TL
Evaluation results
| Method | Links | |
|---|---|---|
| FusionSQL-TLModel=Qwen2.5-72B2026.03 | 1.5 | |
| FusionSQLModel=Qwen2.5-72B2026.03 | 1.6 | |
| FusionSQL-TLModel=Llama-3.1-70B2026.03 | 1.7 | |
| FusionSQLModel=Llama-3.1-70B2026.03 | 1.8 | |
| FusionSQL-TLModel=DeepSeek-33B2026.03 | 2 | |
| FusionSQL-TLModel=Avg.2026.03 | 2 | |
| FusionSQLModel=DeepSeek-33B2026.03 | 2.1 | |
| FusionSQLModel=Avg.2026.03 | 2.1 | |
| FusionSQL-TLModel=XiYanSQL-14B2026.03 | 2.2 | |
| FusionSQLModel=XiYanSQL-14B2026.03 | 2.3 | |
| FusionSQL-TLModel=CSC-SQL-7B2026.03 | 2.4 | |
| FusionSQLModel=CSC-SQL-7B2026.03 | 2.5 | |
| ArenaCmpModel=Qwen2.5-72B2026.03 | 3.9 | |
| ArenaCmpModel=Llama-3.1-70B2026.03 | 4.4 | |
| ArenaCmpModel=DeepSeek-33B2026.03 | 4.9 | |
| ArenaCmpModel=Avg.2026.03 | 4.9 | |
| ArenaCmpModel=XiYanSQL-14B2026.03 | 5.4 | |
| PseAutoEvalModel=Qwen2.5-72B2026.03 | 5.5 | |
| ArenaCmpModel=CSC-SQL-7B2026.03 | 5.9 | |
| PseAutoEvalModel=Llama-3.1-70B2026.03 | 6.1 | |
| BugJudgeModel=Qwen2.5-72B2026.03 | 6.1 | |
| ATC-MCModel=Qwen2.5-72B2026.03 | 6.5 | |
| PseAutoEvalModel=DeepSeek-33B2026.03 | 6.7 | |
| PseAutoEvalModel=Avg.2026.03 | 6.7 | |
| BugJudgeModel=Llama-3.1-70B2026.03 | 6.7 | |
| ATC-NEModel=Qwen2.5-72B2026.03 | 7.1 | |
| ATC-MCModel=Llama-3.1-70B2026.03 | 7.2 | |
| PseAutoEvalModel=XiYanSQL-14B2026.03 | 7.2 | |
| BugJudgeModel=DeepSeek-33B2026.03 | 7.3 | |
| BugJudgeModel=Avg.2026.03 | 7.3 | |
| DoC (τ=0.8)Model=Qwen2.5-72B2026.03 | 7.7 | |
| ATC-MCModel=DeepSeek-33B2026.03 | 7.8 | |
| ATC-MCModel=Avg.2026.03 | 7.8 | |
| ATC-NEModel=Llama-3.1-70B2026.03 | 7.8 | |
| PseAutoEvalModel=CSC-SQL-7B2026.03 | 7.8 | |
| BugJudgeModel=XiYanSQL-14B2026.03 | 7.9 | |
| ATC-MCModel=XiYanSQL-14B2026.03 | 8.3 | |
| DoC (τ=0.8)Model=Llama-3.1-70B2026.03 | 8.3 | |
| ATC-NEModel=DeepSeek-33B2026.03 | 8.4 | |
| ATC-NEModel=Avg.2026.03 | 8.4 | |
| BugJudgeModel=CSC-SQL-7B2026.03 | 8.4 | |
| DoC (τ=0.8)Model=DeepSeek-33B2026.03 | 8.8 | |
| DoC (τ=0.8)Model=Avg.2026.03 | 8.8 | |
| DoC (τ=0.9)Model=Qwen2.5-72B2026.03 | 8.8 | |
| ATC-MCModel=CSC-SQL-7B2026.03 | 9 | |
| ATC-NEModel=XiYanSQL-14B2026.03 | 9 | |
| DoC (τ=0.8)Model=XiYanSQL-14B2026.03 | 9.3 | |
| DoC (τ=0.9)Model=Llama-3.1-70B2026.03 | 9.3 | |
| ATC-NEModel=CSC-SQL-7B2026.03 | 9.6 | |
| DoC (τ=0.9)Model=DeepSeek-33B2026.03 | 9.8 | |
| DoC (τ=0.9)Model=Avg.2026.03 | 9.8 | |
| DoC (τ=0.8)Model=CSC-SQL-7B2026.03 | 9.9 | |
| DoC (τ=0.9)Model=XiYanSQL-14B2026.03 | 10.4 | |
| DoC (τ=0.9)Model=CSC-SQL-7B2026.03 | 10.9 |