Semantic Parsing on SMCalFlow-CS 32-C v1 & v2
64.7Accuracy (v2)Cover-LS (NoFT)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Cover-LS (NoFT)2022.12 | 64.7 | 75.1 | |
| T5 Base (FT)Source=Qiu et al. 2022b2022.12 | 58.9 | — | |
| T5 Large (fine tuned w/o prompts)2022.12 | 53.6 | 56.1 | |
| PaLM 62B (FT)Source=Qiu et al. 2022b2022.12 | 51.1 | — | |
| Top-K (NoFT)2022.12 | 43.9 | 49.6 | |
| T5 11B (Prompt Tuning)Source=Qiu et al. 2022b2022.12 | 23.6 | — | |
| PaLM 540B (ICL)Source=Qiu et al. 2022b2022.12 | 11.7 | — | |
| T5 Base + CSL-Aug (FT)Source=Qiu et al. 2022a2022.12 | — | 70.4 |