Semantic Parsing on SMCalFlow-CS (32-C)
70.4AccuracyT5+CSL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| T5+CSLCSL=true2022.12 | 70.4 | — | |
| BART + R-Dangleshrinterval=6, backbone=BART-large2022.12 | 64.1 | — | |
| C2F+SSSS=true2022.12 | 61.9 | — | |
| BARTmodel_size=large2022.12 | 61.9 | — | |
| BERT2SEQ+SSSS=true2022.12 | 61.7 | — | |
| T52022.12 | 59 | — | |
| C2F2022.12 | 54.6 | — | |
| BERT2SEQ2022.12 | 53.5 | — | |
| Cover-LSModel=Codex2022.12 | — | 73.5 | |
| Cover-LS (Oracle)Model=Codex, Oracle Status=true2022.12 | — | 75.3 | |
| Cover-UttModel=Codex2022.12 | — | 69.7 | |
| DPPModel=Codex2022.12 | — | 59.7 | |
| RandomModel=Codex2022.12 | — | 2 | |
| T5 (fine tuned w/o prompts)Model=T5-large2022.12 | — | 50 | |
| Top-KModel=Codex2022.12 | — | 50.3 | |
| Top-K (Oracle)Model=Codex, Oracle Status=true2022.12 | — | 59.6 |