MSC
Benchmarks
TaskDatasetSOTA resultTrendResults
MSC
35.8B-4 Score
38
MSC
1ROC-AUC
24
MSC (test)
8.431PPL
14
MSC Session 3
24.18BLEU-1 Score
10
MSC Session Openings 1.0 (val)
7.78Perplexity
10
MSC Session 5 1.0 (val)
8.99Perplexity
10
MSC Session 4 1.0 (val)
9.07Perplexity
10
MSC Session 3 1.0 (val)
8.96Perplexity
10
MSC Session 2 1.0 (val)
9.08Perplexity
10
MSC Session 1 1.0 (val)
8.14Perplexity
10
MSC Average
20.01BLEU-1
5
MSC Session 5
20.57BLEU-1
5
MSC Session 4
20.19BLEU-1
5
MSC Session 2
19.54BLEU-1
5
MSC
1.23SacreBLEU
5
MSC
77.2RP@10
5
MSC N=100 (test)
4.85Coherence
4
MSC
8.385Perplexity (PPL)
4
MSC persona
99.2R@10
4
msc10848
1,014.04Memory (MB)
4
MSC (test)
72.5UAR
3
MSC (test)
289Wins
2
MSC 10% human-annotated sample
64.12Topic Consistency
1
MSC
0.927AUC
1