List your company
ResearchFormerly WizWand

Semantic Parsing on COVR-10 (test)

83.2Exact Match AccuracyCover-LS (Oracle)
19.03235.69152.3569.009Dec 13, 2022
Updated 8mo ago

Evaluation results

MethodLinks
Cover-LS (Oracle)Model=Codex, Oracle Status=true2022.1283.2
Cover-UttModel=Codex2022.1278.1
RandomModel=Codex2022.1269.4
Cover-LSModel=Codex2022.1264.4
DPPModel=Codex2022.1262.7
Top-KModel=Codex2022.1261.8
Top-K (Oracle)Model=Codex, Oracle Status=true2022.1235.4
T5 (fine tuned w/o prompts)Model=T5-large2022.1221.5