Semantic Parsing on CFQ MCD3 (test)
77.9AccuracyLIRind+RIR
Evaluation results
| Method | Links | |
|---|---|---|
| LIRind+RIRBackbone=T5, Model Scale=3B2021.04 | 77.9 | |
| LIRind+RIRBackbone=T5, Model Scale=large2021.04 | 72.7 | |
| HPD2021.04 | 67.8 | |
| IBT2021.04 | 64.6 | |
| RIRBackbone=T5, Model Scale=3B2021.04 | 63.5 | |
| RIRBackbone=T5, Model Scale=large2021.04 | 57.1 | |
| LIRind+RIRBackbone=T5, Model Scale=base2021.04 | 53.6 | |
| RIRBackbone=T5, Model Scale=base2021.04 | 46.8 | |
| BaselineBackbone=T5, Model Scale=3B2021.04 | 42.6 | |
| BaselineBackbone=T5, Model Scale=large2021.04 | 25.4 | |
| BaselineBackbone=T5, Model Scale=base2021.04 | 18.4 | |
| Univ. Trans.2021.04 | 11.3 | |
| LSTM+A2021.04 | 10.8 | |
| Evol. Trans.2021.04 | 10.8 | |
| Transformer2021.04 | 10.6 |