Semantic Parsing on CFQ MCD3
95.5AccuracyDynamic Least-to-Most Prompting
Evaluation results
| Method | Links | |
|---|---|---|
| Dynamic Least-to-Most PromptingAlgorithm Type=CFQ-specific2023.05 | 95.5 | |
| LEARAlgorithm Type=CFQ-specific2023.05 | 91.7 | |
| LIR+RIRBackbone=T5-3B, Algorithm Type=CFQ-specific2023.05 | 77.9 | |
| Grounded Graph DecodingAlgorithm Type=CFQ-specific2023.05 | 77.4 | |
| Hierarchical Poset DecodingHierarchical mechanism status=enabled2020.10 | 67.8 | |
| HPDAlgorithm Type=CFQ-specific2023.05 | 67.8 | |
| LIR+RIRBackbone=T5-base, Algorithm Type=CFQ-specific2023.05 | 53.6 | |
| Hierarchical Poset DecodingSketch prediction method=Seq2Tree-based2020.10 | 51.1 | |
| Hierarchical Poset DecodingSketch prediction method=Seq2Seq-based2020.10 | 50.2 | |
| LSPBackbone=T5-base, Algorithm Type=Domain general2023.05 | 43.8 | |
| T5Backbone=T5-3B, Algorithm Type=Domain general2023.05 | 42.6 | |
| T5-11B-modAlgorithm Type=CFQ-specific2023.05 | 33.3 | |
| LSPBackbone=LSTM Encoder, Algorithm Type=Domain general2023.05 | 23.1 | |
| TransformerSPARQL expression type=simplified2020.10 | 21.6 | |
| LSTM+AttentionSPARQL expression type=simplified2020.10 | 21.5 | |
| LAGRAlgorithm Type=CFQ-specific2023.05 | 20.9 | |
| T5Backbone=T5-base, Algorithm Type=Domain general2023.05 | 18.4 | |
| Edge Transformer2021.12 | 13.2 | |
| Edge TransformerAlgorithm Type=Domain general2023.05 | 13.2 | |
| Universal Transformer2021.12 | 11.62 | |
| Universal TransformerSPARQL expression type=standard2020.10 | 11.3 | |
| Universal Transformersource_paper=Keysers et al. (2020)2021.12 | 11.3 | |
| Universal TransformerAlgorithm Type=Domain general2023.05 | 11.3 | |
| LSTM+AttentionSPARQL expression type=standard2020.10 | 10.8 | |
| Evolved Transformersource_paper=Furrer et al. (2020)2021.12 | 10.8 | |
| Evolved TransformerAlgorithm Type=Domain general2023.05 | 10.8 | |
| LSTMAlgorithm Type=Domain general2023.05 | 10.8 | |
| TransformerSPARQL expression type=standard2020.10 | 10.6 | |
| T5-smallsource_paper=Furrer et al. (2020)2021.12 | 10.6 | |
| TransformerAlgorithm Type=Domain general2023.05 | 10.6 | |
| Hierarchical Poset DecodingHierarchical mechanism status=disabled2020.10 | 10.1 | |
| Seq2Tree2020.10 | 6.3 | |
| CGPS2020.10 | 1.82 |