Semantic Parsing on CFQ MCD1 (test)
88.7AccuracyRIR
Evaluation results
| Method | Links | |
|---|---|---|
| RIRBackbone=T5, Model Scale=large2021.04 | 88.7 | |
| RIRBackbone=T5, Model Scale=3B2021.04 | 88.7 | |
| LIRind+RIRBackbone=T5, Model Scale=large2021.04 | 88.6 | |
| LIRind+RIRBackbone=T5, Model Scale=3B2021.04 | 88.4 | |
| RIRBackbone=T5, Model Scale=base2021.04 | 86.3 | |
| LIRind+RIRBackbone=T5, Model Scale=base2021.04 | 85.8 | |
| HPD2021.04 | 79.6 | |
| BaselineBackbone=T5, Model Scale=large2021.04 | 65.1 | |
| BaselineBackbone=T5, Model Scale=3B2021.04 | 65 | |
| IBT2021.04 | 64.8 | |
| BaselineBackbone=T5, Model Scale=base2021.04 | 58.5 | |
| Evol. Trans.2021.04 | 42.4 | |
| Univ. Trans.2021.04 | 37.4 | |
| Transformer2021.04 | 34.9 | |
| LSTM+A2021.04 | 28.9 |