ResearchBenchmarksText-to-SQL on OmniSQL-Spider (test)Text-to-SQL on OmniSQL-Spider (test)Follow88.1Execution Accuracy (easy)SimPO63.97270.23676.582.764May 9, 2026Evaluation resultsMethodMethodLinksExecution Accuracy (easy)Execution Accuracy (medium)Execution Accuracy (hard)Execution Accuracy (extra)Execution Accuracy (all)SimPOBase Model=OmniSQL-7B,...Base Model=OmniSQL-7B, Training Strategy=Preference-tuned2026.0588.160.369.362.768.7ξ-DPOBase Model=OmniSQL-7B,...Base Model=OmniSQL-7B, Training Strategy=Preference-tuned2026.0587.960.87062.569SFTBase Model=OmniSQL-7B,...Base Model=OmniSQL-7B, Training Strategy=Supervised Fine-Tuning2026.0564.94452.547.651