AMI
Benchmarks
TaskDatasetSOTA resultTrendResults
AMI
8.43WER
46
AMI (test)
10.8Word Error Rate
38
AMI
3.6DER
28
AMI manual transcriptions
42.43ROUGE-1 Recall (R)
22
AMI
92.41I1 Score
16
AMI SDM (test)
22.07tcpWER
14
AMI IHM (test)
16.4cpWER
12
AMI SDM
18.6cpWER
12
AMI IHM
7.8WER
12
AMI
24.62CP-WER
11
AMI (test)
30.34F1 Score
10
AMI
53.44ROUGE-1
10
AMI MixHeadset
1.73DER (%)
10
AMI 30s
21.3DER
9
AMI (test)
4.13Conciseness
9
AMI Lapel
1.99DER
8
AMI (test)
8.4DER
8
AMI SDM English (eval)
17.7WER
8
AMI-IHM-Mix
28.4WER
7
AMI IHM
19.21WER
6
AMI
64.8AAS
6
AMI IHM (unlabeled)
10.09WER
6
AMI IHM (test)
9.35WER (%)
6
AMI MDM (test)
28.57tcpWER
5
AMI
0.007FAR
5