Text-to-SQL on Spider 2.0 (test)
26.7Execution Accuracy (Spider 2.0 Test)QAFD-RAG + SQL-Agent
Evaluation results
| Method | Links | |
|---|---|---|
| QAFD-RAG + SQL-AgentLLM=GPT-4o, Generator=SQL-Agent2026.04 | 26.7 | |
| Spider-AgentLLM=GPT-4o2026.04 | 21.5 | |
| CHASE-SQLLLM=GPT-4o2026.04 | 11.85 | |
| Oracle2026.04 | 9 | |
| ATR (w. UAE)Retrieval Type=Adaptive2026.04 | 4.8 | |
| ATR (w. Contriever)Retrieval Type=Adaptive2026.04 | 4.6 | |
| UAEk=102026.04 | 4.4 | |
| Murrek=102026.04 | 4.1 | |
| Murrek=52026.04 | 3.9 | |
| JAR (w. Contriever)k=102026.04 | 3.9 | |
| UAEk=52026.04 | 3.9 | |
| RankZephyrk=102026.04 | 3.7 | |
| Contrieverk=102026.04 | 3.7 | |
| UAEk=32026.04 | 3.7 | |
| RankZephyrk=52026.04 | 3.5 | |
| JAR (w. UAE)k=52026.04 | 3.2 | |
| Contrieverk=52026.04 | 3.2 | |
| RankZephyrk=32026.04 | 3.2 | |
| Contrieverk=32026.04 | 3.2 | |
| JAR (w. UAE)k=102026.04 | 3 | |
| JAR (w. Contriever)k=52026.04 | 3 | |
| JAR (w. UAE)k=32026.04 | 3 | |
| DIN-SQLLLM=GPT-4o2026.04 | 2.74 | |
| Murrek=32026.04 | 2.5 | |
| JAR (w. Contriever)k=32026.04 | 2.3 | |
| DAIL-SQLLLM=GPT-4o2026.04 | 0 | |
| CodeSLLM=GPT-4o2026.04 | 0 |