Semantic Parsing on CFQ MCD2 (test)
0.853AccuracyLIRind+RIR
Evaluation results
| Method | Links | |
|---|---|---|
| LIRind+RIRBackbone=T5, Model Scale=3B2021.04 | 0.853 | |
| LIRind+RIRBackbone=T5, Model Scale=large2021.04 | 0.792 | |
| RIRBackbone=T5, Model Scale=3B2021.04 | 0.726 | |
| LIRind+RIRBackbone=T5, Model Scale=base2021.04 | 0.64 | |
| RIRBackbone=T5, Model Scale=large2021.04 | 0.622 | |
| HPD2021.04 | 0.596 | |
| IBT2021.04 | 0.578 | |
| RIRBackbone=T5, Model Scale=base2021.04 | 0.491 | |
| BaselineBackbone=T5, Model Scale=3B2021.04 | 0.41 | |
| BaselineBackbone=T5, Model Scale=large2021.04 | 0.323 | |
| BaselineBackbone=T5, Model Scale=base2021.04 | 0.27 | |
| Evol. Trans.2021.04 | 0.093 | |
| Transformer2021.04 | 0.082 | |
| Univ. Trans.2021.04 | 0.081 | |
| LSTM+A2021.04 | 0.05 |