Text-to-SQL on BIRD Synthesized Matched Set
90.39ExM AccuracyTeCoD-SGC
Evaluation Results
| Method | Links | |
|---|---|---|
| TeCoD-SGCModel=XiYanSQL QwenCoder 14B-25042026.04 | 90.39 | |
| TeCoD-GCDModel=XiYanSQL QwenCoder 7B-25042026.04 | 89.48 | |
| TeCoD-GCDModel=Llama-3.1 8B-Instruct2026.04 | 89.22 | |
| TeCoD-GCDModel=Granite-3.1 8B-Instruct2026.04 | 89.22 | |
| TeCoD-GCDModel=CodeS-15B2026.04 | 88.7 | |
| TeCoD-GCDModel=XiYanSQL QwenCoder 14B-25042026.04 | 88.05 | |
| TeCoD-GCDModel=CodeS-1B2026.04 | 86.88 | |
| TeCoD-GCDModel=Granite-3.1 2B-Instruct2026.04 | 86.88 | |
| TeCoD-GCDModel=Snowflake Arctic Text2SQL R1-7B2026.04 | 86.36 | |
| TeCoD-SGCModel=Llama-3.1 8B-Instruct2026.04 | 84.16 | |
| TeCoD-SGCModel=XiYanSQL QwenCoder 7B-25042026.04 | 81.95 | |
| ICL-3Model=XiYanSQL QwenCoder 14B-25042026.04 | 79.87 | |
| TeCoD-SGCModel=Granite-3.1 8B-Instruct2026.04 | 78.31 | |
| ICL-3Model=XiYanSQL QwenCoder 7B-25042026.04 | 77.79 | |
| TeCoD-SGCModel=Snowflake Arctic Text2SQL R1-7B2026.04 | 75.32 | |
| TeCoD-SGCModel=Granite-3.1 2B-Instruct2026.04 | 74.94 | |
| ICL-3Model=Llama-3.1 8B-Instruct2026.04 | 73.9 | |
| TeCoD-SGCModel=CodeS-15B2026.04 | 69.35 | |
| ICL-3Model=Snowflake Arctic Text2SQL R1-7B2026.04 | 69.22 | |
| ICL-3Model=CodeS-15B2026.04 | 64.29 | |
| ZeroShotModel=Snowflake Arctic Text2SQL R1-7B2026.04 | 63.25 | |
| ICL-3Model=Granite-3.1 2B-Instruct2026.04 | 62.99 | |
| ICL-3Model=Granite-3.1 8B-Instruct2026.04 | 62.47 | |
| ZeroShotModel=XiYanSQL QwenCoder 14B-25042026.04 | 55.66 | |
| TeCoD-SGCModel=CodeS-1B2026.04 | 54.55 | |
| ZeroShotModel=XiYanSQL QwenCoder 7B-25042026.04 | 54.1 | |
| ZeroShotModel=CodeS-15B2026.04 | 51.3 | |
| ICL-3Model=CodeS-1B2026.04 | 50.65 | |
| ZeroShotModel=Llama-3.1 8B-Instruct2026.04 | 44.81 | |
| ZeroShotModel=CodeS-1B2026.04 | 40.91 | |
| ZeroShotModel=Granite-3.1 8B-Instruct2026.04 | 40.26 | |
| ZeroShotModel=Granite-3.1 2B-Instruct2026.04 | 26.23 |