List your company
ResearchFormerly WizWand

Semantic Parsing on CFQ (MCD1)

98.6AccuracyGrounded Graph Decoding
1.058426.381751.70577.0283Oct 15, 2020Mar 19, 2021Aug 22, 2021Jan 25, 2022Jun 29, 2022Dec 2, 2022May 7, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Grounded Graph DecodingAlgorithm Type=CFQ-specific2023.0598.6
Dynamic Least-to-Most PromptingAlgorithm Type=CFQ-specific2023.0594.3
LEARAlgorithm Type=CFQ-specific2023.0591.7
LSPBackbone=T5-base, Algorithm Type=Domain general2023.0588.7
LIR+RIRBackbone=T5-3B, Algorithm Type=CFQ-specific2023.0588.4
LIR+RIRBackbone=T5-base, Algorithm Type=CFQ-specific2023.0585.8
Hierarchical Poset DecodingHierarchical mechanism status=enabled2020.1079.6
HPDAlgorithm Type=CFQ-specific2023.0579.6
Hierarchical Poset DecodingSketch prediction method=Seq2Tree-based2020.1075.7
Hierarchical Poset DecodingSketch prediction method=Seq2Seq-based2020.1074.3
LSPBackbone=LSTM Encoder, Algorithm Type=Domain general2023.0573
T5Backbone=T5-3B, Algorithm Type=Domain general2023.0565
T5-11B-modAlgorithm Type=CFQ-specific2023.0561.6
T5Backbone=T5-base, Algorithm Type=Domain general2023.0558.5
LAGRAlgorithm Type=CFQ-specific2023.0557.9
TransformerSPARQL expression type=simplified2020.1053
Edge Transformer2021.1247.73
Edge TransformerAlgorithm Type=Domain general2023.0547.7
Universal Transformer2021.1242.7
T5-smallsource_paper=Furrer et al. (2020)2021.1242.5
Evolved Transformersource_paper=Furrer et al. (2020)2021.1242.4
Evolved TransformerAlgorithm Type=Domain general2023.0542.4
LSTM+AttentionSPARQL expression type=simplified2020.1042.2
Universal TransformerSPARQL expression type=standard2020.1037.4
Universal Transformersource_paper=Keysers et al. (2020)2021.1237.4
Universal TransformerAlgorithm Type=Domain general2023.0537.4
TransformerSPARQL expression type=standard2020.1034.9
TransformerAlgorithm Type=Domain general2023.0534.9
LSTM+AttentionSPARQL expression type=standard2020.1028.9
LSTMAlgorithm Type=Domain general2023.0528.9
Seq2Tree2020.1024.3
Hierarchical Poset DecodingHierarchical mechanism status=disabled2020.1021.3
CGPS2020.104.81