Text-to-SQL Data Generation on Synthetic Business-Logic Text-to-SQL Dataset Salesforce SOQL 1.0 (test)
0.9859Question-SQL AlignmentBusiness Logic–Driven Data Synthesis
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Business Logic–Driven Data SynthesisEvaluation LLM=Gemini3 Pro2026.01 | 0.9859 | 0.9844 | |
| OmniSQLEvaluation LLM=Gemini3 Pro2026.01 | 0.9547 | 0.7891 | |
| Business Logic–Driven Data SynthesisEvaluation LLM=Claude Sonnet 4.52026.01 | 0.9094 | 0.9734 | |
| SQL-FactoryEvaluation LLM=Gemini3 Pro2026.01 | 0.904 | 0.4375 | |
| OmniSQLEvaluation LLM=Claude Sonnet 4.52026.01 | 0.8859 | 0.8094 | |
| SQL-FactoryEvaluation LLM=Claude Sonnet 4.52026.01 | 0.8415 | 0.4543 |