List your company
ResearchFormerly WizWand

Text-to-SQL on WikiSQL Fully-supervised (test)

90.8Execution AccuracyGuo & Gao w. GRAPPA (MLM+SSP)
78.00881.32984.6587.971Sep 29, 2020
Updated 8mo ago

Evaluation results

MethodLinks
Guo & Gao w. GRAPPA (MLM+SSP)Execution-guided decoding=false, Backbone=GRAPPA, Pre-training Objective=MLM+SSP2020.0990.8
Guo & Gao w. GRAPPA (MLM)Execution-guided decoding=false, Backbone=GRAPPA, Pre-training Objective=MLM2020.0990.7
Guo & Gao w. GRAPPA (SSP)Execution-guided decoding=false, Backbone=GRAPPA, Pre-training Objective=SSP2020.0990.7
Guo & Gao w. RoBERTa-largeExecution-guided decoding=false, Backbone=RoBERTa-large2020.0990.6
Lyu et al.Execution-guided decoding=false2020.0989.2
Guo & GaoExecution-guided decoding=false2020.0989.2
He et al.Execution-guided decoding=false2020.0988.7
Hwang et al.Execution-guided decoding=false2020.0986.2
Shi et al.Execution-guided decoding=false2020.0983.7
Guo & Gao w. GRAPPA (MLM+SSP) (10k)Execution-guided decoding=false, Backbone=GRAPPA, Pre-training Objective=MLM+SSP, Training Data Scale=10k2020.0982.2
Guo & Gao w. RoBERTa-large (10k)Execution-guided decoding=false, Backbone=RoBERTa-large, Training Data Scale=10k2020.0979.2
Dong & LapataExecution-guided decoding=false2020.0978.5