Semantic Parsing on SMCalFlow-CS 16-C v1 & v2
60.3Accuracy v2Cover-LS (NoFT)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Cover-LS (NoFT)2022.12 | 60.3 | 60.9 | |
| T5 Base (FT)Source=Qiu et al. 2022b2022.12 | 43.6 | — | |
| PaLM 62B (FT)Source=Qiu et al. 2022b2022.12 | 34.7 | — | |
| T5 Large (fine tuned w/o prompts)2022.12 | 33.6 | 43 | |
| Top-K (NoFT)2022.12 | 33.6 | 37.7 | |
| T5 11B (Prompt Tuning)Source=Qiu et al. 2022b2022.12 | 10 | — | |
| PaLM 540B (ICL)Source=Qiu et al. 2022b2022.12 | 5 | — | |
| T5 Base + CSL-Aug (FT)Source=Qiu et al. 2022a2022.12 | — | 59 |