EVAL
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
EVAL-100 Retrieval SNOMED-25
24MRR
24
Eval-400 In-house
4.712S Score
11
Eval2000 Fisher-Switchboard 2300-h (test)
10.9WER
9
Eval-400 In-house (test)
66Correctness
7
Eval2000 (test)
12.1ROUGE-L
6
Eval2000
3.34UTMOS
6
Eval2000 (test)
4.92Emotion Rank
5
Eval #1
100Validity
4
Eval2000
1WER
4
Eval2000 Switchboard (SW) 300-hour (test)
12.5WER
4
Eval #3
100Validity
3
Eval 2
100Validity
3
EVAL cross-view
0.939Head
2