Semantic Parsing on SCAN Around Right
100Exact-match AccuracySpanSub+L2S2
Evaluation results
| Method | Links | |
|---|---|---|
| SpanSub+L2S2Base Model=LSTM2023.06 | 100 | |
| SpanSubBase Model=LSTM2023.06 | 99.9 | |
| SQ-TransformerAttention Protocol=SAL2024.02 | 99.63 | |
| Prim2PrimX+METBase Model=LSTM2023.06 | 97.6 | |
| LexLearnBase Model=LSTM2023.06 | 95.3 | |
| Lex Learn2024.02 | 95 | |
| GECA+MAMLBase Model=LSTM2023.06 | 86.2 | |
| GECABase Model=LSTM2023.06 | 84.3 | |
| LexSymBase Model=LSTM2023.06 | 84 | |
| CGPS-RNN2024.02 | 83.2 | |
| CGPS2023.06 | 83.2 | |
| TransformerAttention Protocol=SRL2024.02 | 69.47 | |
| T5-11B2023.06 | 49.2 | |
| Comp-IBT2023.06 | 37.8 | |
| LSTM2023.06 | 10.2 | |
| LSTM-RNN2024.02 | 2.5 |