Context-dependent Text-to-SQL on SParC 1.0 (test)
67.7Question MatchRASAT+PICARD
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| RASAT+PICARDpredict_sql_values=true, decoding_strategy=PICARD2022.05 | 67.7 | 45.2 | 74 | 52.6 | |
| RAT-SQL-TC + GAPpredict_sql_values=false, pre-trained_component=GAP2022.05 | 65.7 | 43.2 | — | — | |
| HIE-SQL + GraPPapredict_sql_values=false, pre-trained_component=GraPPa2022.05 | 64.6 | 42.9 | — | — | |
| RAT-SQL + SCoRepredict_sql_values=false, pre-trained_component=SCoRe2022.05 | 62.4 | 38.1 | — | — | |
| Editing-Based SQL Query GenerationBERT Embedding=utterance-table, query attention=true, sequence editing=true, query source=gold query2019.09 | 54.5 | 25 | — | — | |
| TreeSQL v2+BERTpredict_sql_values=true, pre-trained_component=BERT2022.05 | 48.1 | 25 | 48.5 | 21.6 | |
| Editing-Based SQL Query GenerationBERT Embedding=utterance-table, query attention=true, sequence editing=true, query source=predicted query2019.09 | 47.9 | 25.3 | — | — | |
| GAZP+BERTpredict_sql_values=true, pre-trained_component=BERT2022.05 | 45.9 | 23.5 | 44.6 | 19.7 | |
| CD-Seq2Seqsegment copy=true, query source=gold query2019.09 | 26.7 | 8.4 | — | — | |
| CD-Seq2Seq2019.09 | 23.2 | 7.5 | — | — | |
| CD-Seq2Seqsegment copy=true, query source=predicted query2019.09 | 20.3 | 8.1 | — | — | |
| SyntaxSQL-con2019.09 | 20.2 | 5.2 | — | — |