BABEL
Benchmarks
TaskDatasetSOTA resultTrendResults
BABEL 75% OR
58.54Accuracy
28
BABEL 50% OR
56.97Accuracy
28
BABEL 25% OR
51.71Accuracy
28
BABEL 100% OR
59.65Accuracy
14
Babel
1.09PJ
13
BABEL Subset-2 v1.0 (test)
65.2mAP@0.1
12
BABEL (test)
53.9mAP@tIoU (Subset-1)
12
BABEL 2021 (test)
0FID
10
BABEL
39.31Recall@1
9
BABEL60
47.41Top-1 Accuracy
9
BABEL Swahili sw (test)
21WER
7
BABEL Tagalog tl (test)
29.3WER
7
BABEL Subset-3
48.5mAP@0.1
6
BABEL Subset-1
60.5mAP@0.1
6
BABEL Subset-3 v1.0 (test)
42mAP@0.1
6
BABEL Subset-1 v1.0 (test)
53.7mAP@0.1
6
BABEL Georgian ka (test)
24.3WER
6
BABEL Assamese as (test)
39WER
6
Babel Average (test)
5.77Absolute WER Improvement
6
Babel Lithuanian - LIT IARPA program (test)
66WER
6
Babel Telugu - TEL (test)
82.4WER
6
Babel Kazakh - KAZ IARPA program (test)
71WER
6
Babel Cebuano - CEB IARPA program (test)
70.6WER
6
Babel Tok Pisin - TOK IARPA program (test)
54.3WER
6
Babel Kurmanji - KUR IARPA program (test)
77.7WER
6