ResearchBenchmarksText-to-SQL on BIRD-SQL StreamBenchText-to-SQL on BIRD-SQL StreamBenchFollow53.5Accuracy (Simple)ACE46.11648.03349.9551.867Oct 6, 2025Evaluation resultsMethodMethodLinksAccuracy (Simple)Accuracy (Moderate)Accuracy (Challenging)Average AccuracyACEBase LLM=DeepSeek-V3.1...Base LLM=DeepSeek-V3.1-671B, Adaptation Setting=Offline Adaptation2025.1053.550.756.652.9GEPABase LLM=DeepSeek-V3.1...Base LLM=DeepSeek-V3.1-671B, Adaptation Setting=Offline Adaptation2025.1051.651.957.252.2Base LLMBase LLM=DeepSeek-V3.1...Base LLM=DeepSeek-V3.1-671B, Adaptation Setting=None2025.1046.448.255.147.8