Text-to-SQL on Spider-Syn 1.0 (test)
69.1Exact MatchRESDSQL-3B + NatSQL
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RESDSQL-3B + NatSQLModel Size=3B, Intermediate Representation=NatSQL2023.02 | 69.1 | 76.9 | |
| LGESQL + ELECTRA + SUNBackbone=ELECTRA, Auxiliary=SUN2023.02 | 66.9 | — | |
| LGESQL + ELECTRABackbone=ELECTRA2023.02 | 64.6 | — | |
| TKK-3BModel Size=3B2023.02 | 63 | 68.2 | |
| T5-3BModel Size=3B2023.02 | 59.4 | 65.3 | |
| RAT-SQL + GRAPPABackbone=GRAPPA2023.02 | 49.1 | — | |
| RAT-SQL + BERTBackbone=BERT2023.02 | 48.2 | — |