Text-to-SQL on Spider-Realistic 1.0 (test)
77.4Exact Match (EM)RESDSQL-3B + NatSQL
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RESDSQL-3B + NatSQLModel Size=3B, Intermediate Representation=NatSQL2023.02 | 77.4 | 81.9 | |
| LGESQL + ELECTRA + SUNBackbone=ELECTRA, Auxiliary=SUN2023.02 | 70.9 | — | |
| RASAT + PICARDInference Parser=PICARD2023.02 | 69.7 | 71.9 | |
| LGESQL + ELECTRABackbone=ELECTRA2023.02 | 69.2 | — | |
| T5-3B + PICARDModel Size=3B, Inference Parser=PICARD2023.02 | 68.7 | 71.4 | |
| TKK-3BModel Size=3B2023.02 | 68.5 | 71.1 | |
| T5-3BModel Size=3B2023.02 | 63.2 | 65 | |
| RAT-SQL + GRAPPABackbone=GRAPPA2023.02 | 59.3 | — | |
| RAT-SQL + BERTBackbone=BERT2023.02 | 58.1 | 62.1 |