Semantic Parsing on WikiSQL (dev)
84AccuracyShi et al.
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Shi et al.Supervision Type=Programs2019.09 | 84 | — | — | |
| Structured-Attention ParserSupervision Type=Denotations, Attention Type=structured attention, Configuration=Abstract Programs2019.09 | 79.4 | — | — | |
| Dong and LapataSupervision Type=Programs2019.09 | 79 | — | — | |
| Abstract ProgramsSupervision Type=Denotations, Attention Type=standard attention2019.09 | 75.2 | — | — | |
| Sun et al.Supervision Type=Programs2019.09 | 75.1 | — | — | |
| Agarwal et al.Supervision Type=Denotations2019.09 | 74.9 | — | — | |
| Yu et al.Supervision Type=Programs2019.09 | 74.5 | — | — | |
| Typed Seq2SeqSupervision Type=Denotations2019.09 | 74.5 | — | — | |
| Liang et al.Supervision Type=Denotations2019.09 | 72.2 | — | — | |
| Xu et al.Supervision Type=Programs2019.09 | 69.8 | — | — | |
| Huang et al.Supervision Type=Programs2019.09 | 68.3 | — | — | |
| Wang et al.Supervision Type=Programs2019.09 | 67.1 | — | — | |
| Zhong et al.Supervision Type=Programs2019.09 | 60.8 | — | — | |
| Augmented Pointer Network2017.08 | — | 44.1 | 53.8 | |
| Baseline2017.08 | — | 23.3 | 37 | |
| Max lossYear=2017, Meta-learning=false2018.03 | — | 61.3 | 66.9 | |
| Meta + Max lossLearner=Max loss, Meta-learning=true2018.03 | — | 62.1 | 67.3 | |
| Meta + Pointer lossLearner=Pointer loss, Meta-learning=true2018.03 | — | 52 | 57.7 | |
| Meta + Sum lossLearner=Sum loss, Meta-learning=true2018.03 | — | 63.1 | 68.3 | |
| Pointer lossYear=2017, Meta-learning=false2018.03 | — | 46.8 | 52.1 | |
| PointerNetYear=20172018.03 | — | 44.1 | 53.8 | |
| Seq2SQLreinforcement learning=false2017.08 | — | 48.2 | 58.1 | |
| Seq2SQLreinforcement learning=true2017.08 | — | 49.5 | 60.8 | |
| Seq2SQLYear=20172018.03 | — | 49.5 | 60.8 | |
| Sum lossYear=2017, Meta-learning=false2018.03 | — | 62 | 67.1 |