ATIS
Benchmarks
TaskDatasetSOTA resultTrendResults
ATIS
97.92Micro F1
64
ATIS (test)
96.89F1 Score
55
ATIS
99.43ID Accuracy
32
ATIS (test)
86.79Macro F1
20
ATIS
95.1Accuracy
19
ATIS target
95.5F1 Score
18
ATIS (test)
96.89Slot F1
18
ATIS
96.1Slot F1
16
ATIS
98.46F1 Score
14
ATIS
47.8Exact Match Accuracy
13
ATIS (test)
1.57Intent Error
13
ATIS template (test)
47.8Accuracy
12
ATIS (test)
97.9Intent Accuracy
12
ATIS (test)
6.39WER
11
ATIS (test)
96Slot F1
11
ATIS (test)
10.19PPL (LM)
11
Persian-ATIS standard (test)
79.03Macro F1
10
ATIS (dev)
40.2Query Acc
10
ATIS (unsupervised)
89.7Accuracy
9
ATIS (test)
1.1WER
9
ATIS
1.45WER
9
ATIS
97.8F1 Score
8
ATIS (test)
1.1WER
8
ATIS (test)
91.3Accuracy
8
Atis
86.05T-EM
7