Persona-Chat
Benchmarks
TaskDatasetSOTA resultTrendResults
Persona-Chat
53.3BLEU-1
20
Persona-Chat (val)
77.01Accuracy
13
PERSONA-CHAT Original (dev)
89.5Hits@1
13
PERSONA-CHAT Revised (test)
82.79R@1
11
PERSONA-CHAT Original Persona (test)
87.45R@1
11
PERSONA-CHAT Revised (dev)
85Hits@1
11
Persona-Chat 1.0 (test)
4.31Fluency
9
Persona-Chat
1.1Error Rate (Profile)
8
PERSONA-CHAT (test)
7.71ROUGE Score
7
Persona-Chat (test)
11.5Accuracy
6
PERSONA-CHAT Revised v1
0.354Hits@1
6
PERSONA-CHAT Original v1
51.1Hits@1
6
PERSONA-CHAT No Persona v1
0.349Hits@1
6
PERSONA-CHAT (val)
82.1Hits@1
5
Persona-Chat
83CCS
4
PERSONA-CHAT (test)
19.5F1
4
Persona-Chat turn-level (test)
0.631Spearman Correlation
3
Persona-Chat turn-level (test)
0.263Spearman Correlation
3
Persona-Chat turn-level (test)
0.563Spearman Corr (Context)
3
Persona-Chat turn-level (test)
0.132Spearman Correlation (Understandable)
3
PERSONA-CHAT synthesized Revised (test)
78.2Hits@1
3
PERSONA-CHAT synthesized Original (test)
93.8Hits@1
3
PERSONA-CHAT original (dev)
41.7Category 1 Score
3