List your company
ResearchFormerly WizWand

Semantic Parsing on SMCalFlow CS (i.i.d.)

88.5Exact Match AccuracyT5 (fine tuned w/o prompts)
41.1853.46565.7578.035Dec 13, 2022
Updated 8mo ago

Evaluation results

MethodLinks
T5 (fine tuned w/o prompts)Model=T5-large2022.1288.5
Cover-LSModel=Codex2022.1286
Top-K (Oracle)Model=Codex, Oracle Status=true2022.1285
Cover-LS (Oracle)Model=Codex, Oracle Status=true2022.1284.3
Cover-UttModel=Codex2022.1283.3
Top-KModel=Codex2022.1281.7
DPPModel=Codex2022.1279.3
RandomModel=Codex2022.1243