Sequence Classification on ATIS
97.92Micro F1ABEX
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ABEXNumber of training samples=10002024.06 | 97.92 | — | |
| AEDANumber of training samples=10002024.06 | 97.63 | — | |
| ABEXNumber of training samples=5002024.06 | 97.33 | — | |
| Gold-onlyNumber of training samples=10002024.06 | 97.29 | — | |
| GENIUSNumber of training samples=10002024.06 | 97.18 | — | |
| BackTransNumber of training samples=5002024.06 | 97.07 | — | |
| PromDANumber of training samples=10002024.06 | 96.95 | — | |
| ABEX-stage-1Number of training samples=5002024.06 | 96.79 | — | |
| ABEX-stage-2Number of training samples=5002024.06 | 96.75 | — | |
| EDANumber of training samples=10002024.06 | 96.73 | — | |
| AEDANumber of training samples=5002024.06 | 96.73 | — | |
| GENIUSNumber of training samples=5002024.06 | 96.73 | — | |
| ABEX-stage-2Number of training samples=10002024.06 | 96.68 | — | |
| BackTransNumber of training samples=10002024.06 | 96.62 | — | |
| EDANumber of training samples=5002024.06 | 96.62 | — | |
| ABEX-stage-1Number of training samples=10002024.06 | 96.45 | — | |
| AMR-DANumber of training samples=10002024.06 | 96.39 | — | |
| AMR-DANumber of training samples=5002024.06 | 96.28 | — | |
| SSMBANumber of training samples=10002024.06 | 95.94 | — | |
| ABEXNumber of training samples=2002024.06 | 95.71 | — | |
| EDANumber of training samples=2002024.06 | 94.93 | — | |
| ABEX-stage-1Number of training samples=2002024.06 | 94.83 | — | |
| PromDANumber of training samples=5002024.06 | 94.81 | — | |
| Gold-onlyNumber of training samples=5002024.06 | 94.7 | — | |
| BackTransNumber of training samples=2002024.06 | 94.36 | — | |
| ABEXNumber of training samples=1002024.06 | 94.28 | — | |
| PromDANumber of training samples=2002024.06 | 94.25 | — | |
| GENIUSNumber of training samples=2002024.06 | 94.14 | — | |
| AMR-DANumber of training samples=2002024.06 | 94.03 | — | |
| AMR-DANumber of training samples=1002024.06 | 93.69 | — | |
| SSMBANumber of training samples=5002024.06 | 93.69 | — | |
| GENIUSNumber of training samples=1002024.06 | 93.58 | — | |
| PromDANumber of training samples=1002024.06 | 92.68 | — | |
| ZeroGenNumber of training samples=5002024.06 | 92.51 | — | |
| ZeroGenNumber of training samples=10002024.06 | 92.36 | — | |
| ABEX-stage-2Number of training samples=2002024.06 | 92.36 | — | |
| BackTransNumber of training samples=1002024.06 | 92.34 | — | |
| EDANumber of training samples=1002024.06 | 92.11 | — | |
| AEDANumber of training samples=2002024.06 | 91.89 | — | |
| ABEX-stage-1Number of training samples=1002024.06 | 91.66 | — | |
| ZeroGenNumber of training samples=2002024.06 | 91.05 | — | |
| LLAMA-2 13BNumber of training samples=10002024.06 | 91.05 | — | |
| PromptMixNumber of training samples=10002024.06 | 90.88 | — | |
| ABEX-stage-2Number of training samples=1002024.06 | 90.71 | — | |
| SSMBANumber of training samples=1002024.06 | 90.31 | — | |
| Gold-onlyNumber of training samples=2002024.06 | 89.97 | — | |
| SSMBANumber of training samples=2002024.06 | 89.75 | — | |
| PromptMixNumber of training samples=5002024.06 | 89.47 | — | |
| ZeroGenNumber of training samples=1002024.06 | 89.11 | — | |
| LLAMA-2 13BNumber of training samples=5002024.06 | 89.11 | — | |
| AEDANumber of training samples=1002024.06 | 89.07 | — | |
| PromptMixNumber of training samples=2002024.06 | 88.39 | — | |
| PromptMixNumber of training samples=1002024.06 | 86.72 | — | |
| ABEX-AbsNumber of training samples=10002024.06 | 86.49 | — | |
| GPT3MixNumber of training samples=5002024.06 | 85.36 | — | |
| GPT3MixNumber of training samples=10002024.06 | 85.36 | — | |
| Gold-onlyNumber of training samples=1002024.06 | 85.13 | — | |
| ABEX-AbsNumber of training samples=5002024.06 | 83.54 | — | |
| LLAMA-2 13BNumber of training samples=1002024.06 | 82.8 | — | |
| GPT3MixNumber of training samples=2002024.06 | 81.75 | — | |
| LLAMA-2 13BNumber of training samples=2002024.06 | 81.72 | — | |
| ABEX-AbsNumber of training samples=2002024.06 | 80.27 | — | |
| ABEX-AbsNumber of training samples=1002024.06 | 78.53 | — | |
| GPT3MixNumber of training samples=1002024.06 | 76.91 | — | |
| GPT-4o2025.12 | — | 90 | |
| LOCUSparam=185M2025.12 | — | 91.4 | |
| LOCUSminiparam=5M2025.12 | — | 86.4 |