List your company
ResearchFormerly WizWand

Text-to-SQL on Spider Real

0.841Execution AccuracyReward-SQL + Qwen3-8B
0.564360.636180.7080.77982May 7, 2025
Updated 4mo ago

Evaluation results

MethodLinks
Reward-SQL + Qwen3-8BDecoding=Greedy2025.050.841
Reward-SQL + Qwen3-8BDecoding=Maj@82025.050.833
Arctic-SQL + Qwen2.5-7BDecoding=Maj@82025.050.817
OmniSQL + Qwen2.5-7BDecoding=Maj@82025.050.807
SQL-R1 + Qwen2.5-7BDecoding=Maj@82025.050.805
Arctic-SQL + Qwen2.5-7BDecoding=Greedy2025.050.803
SQL-R1 + Qwen2.5-7BDecoding=Greedy2025.050.783
OmniSQL + Qwen2.5-7BDecoding=Greedy2025.050.752
Qwen2.5-Coder-7B-InstructDecoding=Maj@82025.050.705
Qwen2.5-72B-InstructDecoding=Greedy2025.050.701
Qwen2.5-72B-InstructDecoding=Maj@82025.050.685
GPT-4-TurboDecoding=Maj@82025.050.683
DeepSeek-V3 (671B MoE)Decoding=Greedy2025.050.679
GPT-4-TurboDecoding=Greedy2025.050.675
DeepSeek-V3 (671B MoE)Decoding=Maj@82025.050.669
GPT-4oDecoding=Maj@82025.050.667
Qwen2.5-Coder-7B-InstructDecoding=Greedy2025.050.667
GPT-4oDecoding=Greedy2025.050.665
Meta-Llama-3.1-8B-InstructDecoding=Maj@82025.050.61
Meta-Llama-3.1-8B-InstructDecoding=Greedy2025.050.575