ATIS
Benchmarks
TaskDatasetSOTA resultTrendResults
ATIS airline info
2WER
7
ATIS length split
41.39Accuracy
7
ATIS iid
86.96Accuracy
7
ATIS (test)
47Query Accuracy
7
ATIS
98.7AP
6
ATIS (test)
2.1WER
5
ATIS (test)
79.38Macro F1
5
ATIS
96.1Slot F1
5
ATIS noisy speech input (test)
86.87F1 Score
4
ATIS noisy speech input (test)
4.44Intent Error Rate
4
ATIS noisy speech input (test)
12.59WER
4
Additional ATIS corpus (10-fold cross val)
5.6Intent Error
4
Additional ATIS corpus (10-fold cross val)
95.78F1 Score
4
ATIS 8 (coarse), 21
98.1Accuracy
3
ATIS Class A (context-independent)
98.5Precision
3
ATIS (unevaluable) (Class X)
65.4Precision
3
ATIS Class D (context-dependent)
81.4Precision
3
Atis (test)
73.88Table EM
2
Persian-ATIS (OOD)
65.49Accuracy
2
ATIS (OOD)
89.01Accuracy
2