Semantic Parsing on SMCalFlow CS (i.i.d.)
88.5Exact Match AccuracyT5 (fine tuned w/o prompts)
Evaluation Results
| Method | Links | |
|---|---|---|
| T5 (fine tuned w/o prompts)Model=T5-large2022.12 | 88.5 | |
| Cover-LSModel=Codex2022.12 | 86 | |
| Top-K (Oracle)Model=Codex, Oracle Status=true2022.12 | 85 | |
| Cover-LS (Oracle)Model=Codex, Oracle Status=true2022.12 | 84.3 | |
| Cover-UttModel=Codex2022.12 | 83.3 | |
| Top-KModel=Codex2022.12 | 81.7 | |
| DPPModel=Codex2022.12 | 79.3 | |
| RandomModel=Codex2022.12 | 43 |