List your company
ResearchFormerly WizWand

Text-to-SQL on WikiSQL Fully-supervised (dev)

91.4Execution AccuracyGuo & Gao w. GRAPPA (MLM)
78.50481.85285.288.548Sep 29, 2020
Updated 8mo ago

Evaluation results

MethodLinks
Guo & Gao w. GRAPPA (MLM)Execution-guided decoding=false, Backbone=GRAPPA, Pre-training Objective=MLM2020.0991.4
Guo & Gao w. RoBERTa-largeExecution-guided decoding=false, Backbone=RoBERTa-large2020.0991.2
Guo & Gao w. GRAPPA (SSP)Execution-guided decoding=false, Backbone=GRAPPA, Pre-training Objective=SSP2020.0991.2
Guo & Gao w. GRAPPA (MLM+SSP)Execution-guided decoding=false, Backbone=GRAPPA, Pre-training Objective=MLM+SSP2020.0991.2
Guo & GaoExecution-guided decoding=false2020.0990.3
He et al.Execution-guided decoding=false2020.0989.5
Lyu et al.Execution-guided decoding=false2020.0989.1
Hwang et al.Execution-guided decoding=false2020.0987.2
Shi et al.Execution-guided decoding=false2020.0984
Guo & Gao w. GRAPPA (MLM+SSP) (10k)Execution-guided decoding=false, Backbone=GRAPPA, Pre-training Objective=MLM+SSP, Training Data Scale=10k2020.0982.3
Guo & Gao w. RoBERTa-large (10k)Execution-guided decoding=false, Backbone=RoBERTa-large, Training Data Scale=10k2020.0979.6
Dong & LapataExecution-guided decoding=false2020.0979