Psychology Counseling Response Generation on PsyCoPref w/o Length Constraint (test)
86.3Mental Issues ScorePsyCo-Llama3-8B
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| PsyCo-Llama3-8BBase Model=Llama3-8B, Alignment=DPO-Iter, Length Constraint=None2025.02 | 86.3 | 88.2 | 87.1 | 87 | 91.4 | 87 | 90.8 | 84.3 | 87 | |
| Llama3-8B + DPOBase Model=Llama3-8B, Alignment=DPO, Length Constraint=None2025.02 | 70.2 | 74.5 | 73.7 | 74.8 | 77.8 | 73.3 | 80 | 74 | 72.9 | |
| Llama3-3B + DPO-IterBase Model=Llama3-3B, Alignment=DPO-Iter, Length Constraint=None2025.02 | 66.7 | 70.9 | 68.7 | 75.7 | 70.4 | 65.8 | 75.4 | 77.9 | 69.4 | |
| Llama3-3B + DPOBase Model=Llama3-3B, Alignment=DPO, Length Constraint=None2025.02 | 57.7 | 59.1 | 57.9 | 63.5 | 54.3 | 53.4 | 60 | 64.7 | 58.5 | |
| Llama3-3BBase Model=Llama3-3B, Alignment=None, Length Constraint=None2025.02 | 30.5 | 27.1 | 26.7 | 30.4 | 28.4 | 24.7 | 36.9 | 28.9 | 28.5 | |
| Llama3-8BBase Model=Llama3-8B, Alignment=None, Length Constraint=None2025.02 | 28.9 | 31.5 | 28 | 33.9 | 23.5 | 29.5 | 33.8 | 26.8 | 29.3 |