List your company
ResearchFormerly WizWand

Text-to-SQL on Archer (dev)

72.1Execution AccuracySOMA-SQL
14.962429.796244.6359.4638Feb 5, 2026Feb 25, 2026Mar 18, 2026Apr 8, 2026Apr 28, 2026May 19, 2026Jun 9, 2026
Updated 4mo ago

Evaluation results

MethodLinks
SOMA-SQLBackbone LLM=GPT-52026.0672.1
SOMA-SQLBackbone LLM=GPT-5.3 Codex2026.0671.2
AutoLinkBackbone LLM=GPT-5.3 Codex2026.0668.3
SOMA-SQLBackbone LLM=Gemma-4-31B2026.0665.4
AutoLinkBackbone LLM=GPT-52026.0664.4
AutoLinkBackbone LLM=Gemma-4-31B2026.0655.8
DeepEye-SQLBackbone LLM=GPT-52026.0649
DeepEye-SQLBackbone LLM=Gemma-4-31B2026.0643.3
DeepEye-SQLBackbone LLM=GPT-5.3 Codex2026.0641.4
IESRBackbone=XiYanSQL, Size=7B2026.0237.28
CHESS-SQLBackbone=XiYanSQL, Size=7B2026.0235.54
IESRBackbone=Qwen2.5-Coder, Size=7B2026.0235.21
Din-sqlBackbone=XiYanSQL, Size=7B2026.0234.41
DTS-SQLBackbone=XiYanSQL, Size=7B2026.0233.17
IESRBackbone=OmniSQL, Size=7B2026.0233.11
CHESS-SQLBackbone=Qwen2.5-Coder, Size=7B2026.0232.45
DAIL-sqlBackbone=XiYanSQL, Size=7B2026.0232.28
DTS-SQLBackbone=OmniSQL, Size=7B2026.0232.14
DTS-SQLBackbone=Qwen2.5-Coder, Size=7B2026.0231.88
CHESS-SQLBackbone=Seed-Coder, Size=8B2026.0231.56
Din-sqlBackbone=Qwen2.5-Coder, Size=7B2026.0231.45
LinkAlignBackbone=XiYanSQL, Size=7B2026.0231.28
Alpha-SQLBackbone=Seed-Coder, Size=8B2026.0231.22
IESRBackbone=Seed-Coder, Size=8B2026.0230.66
DTS-SQLBackbone=Seed-Coder, Size=8B2026.0230.33
LinkAlignBackbone=OmniSQL, Size=7B2026.0230.21
Alpha-SQLBackbone=XiYanSQL, Size=7B2026.0230.12
LinkAlignBackbone=Seed-Coder, Size=8B2026.0230.1
Alpha-SQLBackbone=OmniSQL, Size=7B2026.0229.88
DAIL-sqlBackbone=Qwen2.5-Coder, Size=7B2026.0229.67
LinkAlignBackbone=Qwen2.5-Coder, Size=7B2026.0229.21
Din-sqlBackbone=Seed-Coder, Size=8B2026.0229.13
SQL-O1Backbone=Seed-Coder, Size=8B, tuning=true2026.0228.78
Alpha-SQLBackbone=Qwen2.5-Coder, Size=7B2026.0228.32
SQL-O1Backbone=XiYanSQL, Size=7B, tuning=true2026.0228.22
DAIL-sqlBackbone=OmniSQL, Size=7B2026.0227.56
SQL-O1Backbone=OmniSQL, Size=7B, tuning=true2026.0227.41
CHESS-SQLBackbone=OmniSQL, Size=7B2026.0227.27
SQL-O1Backbone=Qwen2.5-Coder, Size=7B, tuning=true2026.0226.56
Din-sqlBackbone=OmniSQL, Size=7B2026.0226.04
DAIL-sqlBackbone=Seed-Coder, Size=8B2026.0224.12
Cot-sqlBackbone=Seed-Coder, Size=8B2026.0219.89
Cot-sqlBackbone=XiYanSQL, Size=7B2026.0218.46
Cot-sqlBackbone=OmniSQL, Size=7B2026.0218.14
Cot-sqlBackbone=Qwen2.5-Coder, Size=7B2026.0217.16