Context-dependent Text-to-SQL on SParC 1.0 (dev)
67.7Question MatchRASAT+PICARD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RASAT+PICARDpredict_sql_values=true, decoding_strategy=PICARD2022.05 | 67.7 | 49.1 | 73.3 | 54 | |
| RASATpredict_sql_values=true2022.05 | 65 | 45.7 | 69.9 | 50.7 | |
| HIE-SQL + GraPPapredict_sql_values=false, pre-trained_component=GraPPa2022.05 | 64.7 | 45 | — | — | |
| RAT-SQL-TC + GAPpredict_sql_values=false, pre-trained_component=GAP2022.05 | 64.1 | 44.1 | — | — | |
| RAT-SQL + SCoRepredict_sql_values=false, pre-trained_component=SCoRe2022.05 | 62.2 | 42.5 | — | — | |
| UNIFIEDSKGpredict_sql_values=true2022.05 | 61.5 | 41.9 | 67.3 | 46.4 | |
| Dynamic Hybrid Relation NetworkPre-trained Model=BERT2021.01 | 54.1 | 35.2 | — | — | |
| Editing-Based SQL Query GenerationBERT Embedding=utterance-table, query attention=true, sequence editing=true, query source=gold query2019.09 | 53.4 | 29.2 | — | — | |
| RichContextPre-trained Model=BERT2021.01 | 52.6 | 29.9 | — | — | |
| TreeSQL v2+BERTpredict_sql_values=true, pre-trained_component=BERT2022.05 | 52.6 | 34.4 | 50.4 | 29.4 | |
| GAZP+BERTpredict_sql_values=true, pre-trained_component=BERT2022.05 | 48.9 | 29.7 | 47.8 | — | |
| Editing-Based SQL Query GenerationBERT Embedding=utterance-table, query attention=true, sequence editing=true, query source=predicted query2019.09 | 47.2 | 29.5 | — | — | |
| EditSQLPre-trained Model=BERT2021.01 | 47.2 | 29.5 | — | — | |
| Editing-Based SQL Query GenerationBERT Embedding=utterance-table, query attention=true, query source=predicted query2019.09 | 42.7 | 21.6 | — | — | |
| Dynamic Hybrid Relation NetworkPre-trained Model=GloVe2021.01 | 42.4 | 21.9 | — | — | |
| RichContextPre-trained Model=GloVe2021.01 | 41.8 | 20.6 | — | — | |
| Editing-Based SQL Query Generationquery attention=true, sequence editing=true, query source=gold query2019.09 | 40.6 | 17.3 | — | — | |
| Editing-Based SQL Query GenerationBERT Embedding=utterance-table2019.09 | 40.4 | 18.1 | — | — | |
| Editing-Based SQL Query Generationquery attention=true, sequence editing=true, query source=predicted query2019.09 | 33 | 16.4 | — | — | |
| EditSQLPre-trained Model=GloVe2021.01 | 33 | 16.4 | — | — | |
| Editing-Based SQL Query Generationprevious query as input=false2019.09 | 31.4 | 14.7 | — | — | |
| CD-Seq2Seqsegment copy=true, query source=gold query2019.09 | 27.3 | 10 | — | — | |
| CD-Seq2Seq2019.09 | 21.9 | 8.1 | — | — | |
| CD-Seq2SeqPre-trained Model=GloVe2021.01 | 21.9 | 8.1 | — | — | |
| CD-Seq2Seqsegment copy=true, query source=predicted query2019.09 | 21.7 | 9.5 | — | — | |
| SyntaxSQL-con2019.09 | 18.5 | 4.3 | — | — | |
| SyntaxSQL-conPre-trained Model=GloVe2021.01 | 18.5 | 4.3 | — | — |