List your company
ResearchFormerly WizWand

Semantic Parsing on SMCalFlow-CS (16-C)

73.5AccuracyCover-LS (Oracle)
-2.21217.44437.156.756Dec 12, 2022Jan 8, 2023Feb 5, 2023Mar 5, 2023Apr 1, 2023Apr 29, 2023May 27, 2023
Updated 8mo ago

Evaluation results

MethodLinks
Cover-LS (Oracle)Model=Codex, Oracle Status=true2022.1273.5
T5-base + Tok + Compfew-shot=16-shot, token preprocessing=true, component boundary marking=true2023.0567.7
T5-base + Tokfew-shot=16-shot, token preprocessing=true2023.0565.1
T5-basefew-shot=16-shot2023.0563.9
T5+CSLCSL=true2022.1261.4
Cover-LSModel=Codex2022.1258.3
Top-K (Oracle)Model=Codex, Oracle Status=true2022.1254
Cover-UttModel=Codex2022.1251.3
BART + R-Dangleshrinterval=6, backbone=BART-large2022.1250.6
DPPModel=Codex2022.1250
C2F+SSSS=true2022.1247.4
COARSE2FINE + SS (Span-level Sup.)few-shot=16-shot, supervision=span-level2023.0547.4
BARTmodel_size=large2022.1247.2
BERT2SEQ+SSSS=true2022.1246.8
T52022.1244.7
C2F2022.1240.6
T5 (fine tuned w/o prompts)Model=T5-large2022.1239
Top-KModel=Codex2022.1235.7
BERT2SEQ2022.1233.6
RandomModel=Codex2022.120.7