Text-to-SQL on Spider lite 2.0 (first 100 queries)
52.4Easy Execution AccuracyReCAPAgent-SQL
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ReCAPAgent-SQLBackbone=GPT-4.1, Setting=42026.01 | 52.4 | 32.7 | 8.3 | 31 | |
| ReCAPAgent-SQLBackbone=GPT-4.1, Voting Strategy=WMA, Setting=52026.01 | 52.4 | 32.7 | 8.3 | 31 | |
| ReCAPAgent-SQLBackbone=GPT-4.1, Voting Strategy=RWMA, Setting=62026.01 | 47.6 | 29.1 | 12.5 | 29 | |
| ReCAPAgent-SQLBackbone=Grok-3-beta, Setting=22026.01 | 42.9 | 29.1 | 16.7 | 29 | |
| Grok-3-betaSetting=12026.01 | 38.1 | 20 | 16.7 | 23 | |
| GPT-4.1Setting=3, Implementation=Official Spider-Agent2026.01 | 19 | 3.6 | 0 | 6 |