SAP
Benchmarks
TaskDatasetSOTA resultTrendResults
SAP ROI
14.1MVRR
38
SAP rated (test)
13.38WER
19
SAP All (full)
38.5MVRR
19
SAP All
11.7MVRR
19
SAP Region of Interest
8.8MVRR
19
SAP All sentences
33.7MVRR
19
SAP10
99.4Attack Success Percentage (ASP)
14
SAP ID → EN
57.2d-BLEU
12
SAP VI → ZH
43.8d-BLEU
12
SAP VI → EN
57.2d-BLEU
12
SAP EN → ID
58.2d-BLEU
12
SAP EN → ZH
45.1d-BLEU
12
SAP EN → VI
67.3d-BLEU
12
SAP In-domain (test)
0.726SRCC
10
SAP Dysarthric
10.39WER
5
SAP Overall (test-1)
5.3WER (%)
5
SAP 5-fold CV (test)
6.59WER
4
SAP Overall 2 (test)
8.1WER
3