Semantic Parsing on mTOP (test)
91.8Average ScorePOS-based code-switching
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| POS-based code-switchingLanguage Sequence=EN → HI → BN2026.01 | 91.8 | — | — | — | — | — | — | — | |
| EWCLanguage Sequence=EN → DE → FR2026.01 | 91.49 | — | — | — | — | — | — | — | |
| EWCLanguage Sequence=EN → ES → FR2026.01 | 91.46 | — | — | — | — | — | — | — | |
| EWCLanguage Sequence=EN → FR → ES2026.01 | 90.88 | — | — | — | — | — | — | — | |
| POS-based code-switchingLanguage Sequence=EN → DE → FR2026.01 | 90.63 | — | — | — | — | — | — | — | |
| EWCLanguage Sequence=EN → HI → BN2026.01 | 90.32 | — | — | — | — | — | — | — | |
| POS-based code-switchingLanguage Sequence=EN → TH → KO2026.01 | 90.08 | — | — | — | — | — | — | — | |
| POS-based code-switchingLanguage Sequence=EN → ES → FR2026.01 | 90.07 | — | — | — | — | — | — | — | |
| EWCLanguage Sequence=EN → TH → KO2026.01 | 89.85 | — | — | — | — | — | — | — | |
| POS-based code-switchingLanguage Sequence=EN → FR → ES2026.01 | 89.69 | — | — | — | — | — | — | — | |
| LWFLanguage Sequence=EN → DE → FR2026.01 | 89.33 | — | — | — | — | — | — | — | |
| LWFLanguage Sequence=EN → FR → ES2026.01 | 88.94 | — | — | — | — | — | — | — | |
| LWFLanguage Sequence=EN → ES → FR2026.01 | 88.73 | — | — | — | — | — | — | — | |
| LWFLanguage Sequence=EN → TH → KO2026.01 | 87.89 | — | — | — | — | — | — | — | |
| LWFLanguage Sequence=EN → HI → BN2026.01 | 78.67 | — | — | — | — | — | — | — | |
| Syntax-augmented mBERTsyntax-augmented=true2021.06 | 41.4 | 81.3 | 30 | 43 | 41.2 | 11.5 | — | — | |
| mBERTbaseline=true2021.06 | 39.6 | 81 | 28.1 | 40.2 | 38.8 | 9.8 | — | — | |
| DyckBackbone=T5-Small2022.06 | — | — | — | — | — | — | 65.9 | 91.9 | |
| IdentityBackbone=T5-Small2022.06 | — | — | — | — | — | — | 68.6 | 93 | |
| LIMEBackbone=T5-Small2022.06 | — | — | — | — | — | — | 73.7 | 94 | |
| Nons_SummaryBackbone=T5-Small2022.06 | — | — | — | — | — | — | 68 | 92.7 | |
| Pre-trained_T5Backbone=T5-Small (T5_1.0)2022.06 | — | — | — | — | — | — | 81 | 95.2 | |
| Random_InitBackbone=T5-Small2022.06 | — | — | — | — | — | — | 38.6 | 83 | |
| SetBackbone=T5-Small2022.06 | — | — | — | — | — | — | 71.7 | 93.7 | |
| Wiki 10KBackbone=T5-Small2022.06 | — | — | — | — | — | — | 71.6 | 94.2 |