UltraChat
Benchmarks
TaskDatasetSOTA resultTrendResults
UltraChat
98.7ASR Accuracy
32
UltraChat (8:2)
100MET ASR
21
Ultrachat
95.7Memorization Reduction
20
UltraChat
99.86Accuracy
12
UltraChat
36.8BLEU
8
UltraChat
3,008.3Throughput
6
UltraChat
9.1Overall Score
6
ultrachat Synthetic
7.26Personalization Score
6
UltraChat 8K XSTest-response-Hom variant
0.756AUPRC
5
UltraChat 8K XSTest-response-Het variant
70.75AUPRC
5
UltraChat (test)
0.875Accuracy
4
UltraChat
67.8RM Score
2