List your company
ResearchFormerly WizWand

Semantic Parsing on COGS (test)

99Exact Match AccuracyFull FT
45.9659.7373.587.27Jun 5, 2023Dec 8, 2023Jun 12, 2024Dec 16, 2024Jun 21, 2025Dec 25, 2025Jun 30, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Full FTCategory=No protection, Best Ep=6.02026.0699
WProjCategory=Weight-space, Best Ep=4.42026.0698.92
EWCCategory=Regularization, Best Ep=6.02026.0698.84
ForaCategory=Ours, Best Ep=4.82026.0698.68
FProjCategory=Ours, Best Ep=5.02026.0698.64
L2-SPCategory=Regularization, Best Ep=5.02026.0698.48
SpanSub+L2S2base_model=LSTM2023.0692.3
LwFCategory=Regularization, Best Ep=8.22026.0692.12
SpanSubbase_model=LSTM2023.0691.8
Roberta+Dangle2023.0687.6
T5-Base2023.0685.9
Probabilistic Transformer2023.1184.6
SQ-TransformerAttention Protocol=SRL2024.0283.36
TransformerAttention Protocol=SRL2024.0282.6
Transformer2023.1182.05
Lex Learn2024.0282
LexLearnbase_model=LSTM2023.0682
LexSymbase_model=LSTM2023.0681.4
Prim2PrimX+METbase_model=LSTM2023.0681.1
IR-Transformer2023.0678.4
MAML2023.0664.1
LSTM2023.0655.4
GECAbase_model=LSTM2023.0648