NL2SQL on BEAVER Oracle dialect
36.4Execution AccuracySOMA-SQL
Evaluation results
| Method | Links | |
|---|---|---|
| SOMA-SQLBackbone LLM=GPT-52026.06 | 36.4 | |
| SOMA-SQLBackbone LLM=Gemma-4-31B2026.06 | 36.3 | |
| SOMA-SQLBackbone LLM=GPT-5.3 Codex2026.06 | 30.1 | |
| AutoLinkBackbone LLM=GPT-52026.06 | 23 | |
| AutoLinkBackbone LLM=GPT-5.3 Codex2026.06 | 22.5 | |
| AutoLinkBackbone LLM=Gemma-4-31B2026.06 | 15.3 | |
| DeepEye-SQLBackbone LLM=GPT-52026.06 | 14.1 | |
| DeepEye-SQLBackbone LLM=GPT-5.3 Codex2026.06 | 12 | |
| DeepEye-SQLBackbone LLM=Gemma-4-31B2026.06 | 8.5 |