Text-to-SQL on Spider-SYN 1.0 (val)
66.9EM AccuracyGRAPHIX-T5-3B
Evaluation Results
| Method | Links | |
|---|---|---|
| GRAPHIX-T5-3Bsize=3B, zero-shot=true2023.01 | 66.9 | |
| LGESQL + ELECTRAzero-shot=true2023.01 | 64.6 | |
| GRAPHIX-T5-largesize=large, zero-shot=true2023.01 | 61.1 | |
| T5-3Bsize=3B, zero-shot=true2023.01 | 58 | |
| T5-largesize=large, zero-shot=true2023.01 | 53.6 | |
| RAT-SQL + Grappazero-shot=true2023.01 | 49.1 | |
| RAT-SQL + BERTzero-shot=true2023.01 | 48.2 | |
| RAT-SQLzero-shot=true2023.01 | 33.6 | |
| IRNetzero-shot=true2023.01 | 28.4 | |
| GNNzero-shot=true2023.01 | 23.6 |