Semantic Parsing on GEO FunQL (test)
89.3AccuracyDEPHT
Evaluation results
| Method | Links | |
|---|---|---|
| DEPHTProtocol=Supervised2021.06 | 89.3 | |
| SSDProtocol=Supervised, Inference Level=Word-Level2021.06 | 88.3 | |
| SSDProtocol=Supervised, Inference Level=Grammar-Level2021.06 | 87.9 | |
| SEQ2SEQProtocol=Supervised2021.06 | 87.1 | |
| SSD-SAMPLESProtocol=Unsupervised (with nonparallel data), Inference Level=Grammar-Level2021.06 | 65 | |
| SSD-SAMPLESProtocol=Unsupervised (with nonparallel data), Inference Level=Word-Level2021.06 | 64.3 | |
| SSDProtocol=Unsupervised, Inference Level=Grammar-Level2021.06 | 63.2 | |
| SSDProtocol=Unsupervised, Inference Level=Word-Level2021.06 | 62.8 | |
| SYNTHPARA-SEQ2SEQProtocol=Unsupervised2021.06 | 45.4 | |
| SYNTH-SEQ2SEQProtocol=Unsupervised2021.06 | 36.1 |