Semantic Parsing on SMCalFlow CS (8-C)
77.3Exact Match AccuracyCover-LS (Oracle)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Cover-LS (Oracle)Model=Codex, Oracle Status=true2022.12 | 77.3 | — | |
| Cover-LSModel=Codex2022.12 | 53.3 | — | |
| Cover-UttModel=Codex2022.12 | 51 | — | |
| DPPModel=Codex2022.12 | 44 | — | |
| T5 (fine tuned w/o prompts)Model=T5-large2022.12 | 34.5 | — | |
| Top-KModel=Codex2022.12 | 34 | — | |
| Top-K (Oracle)Model=Codex, Oracle Status=true2022.12 | 33 | — | |
| RandomModel=Codex2022.12 | 0.3 | — | |
| BARTmodel_size=large2022.12 | — | 32.1 | |
| BART + R-Dangleshrinterval=6, backbone=BART-large2022.12 | — | 36.3 | |
| T52022.12 | — | 34.7 | |
| T5+CSLCSL=true2022.12 | — | 51.6 |