Psychology counseling response generation on PsyCoPref w/ Length Constraint (test)
75.6Mental IssuesPsyCo-Llama3-8B
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| PsyCo-Llama3-8BBase Model=Llama3-8B, Alignment=DPO-Iter, Length Constraint=Active2025.02 | 75.6 | 77.9 | 79.2 | 77.4 | 76.5 | 73.3 | 83.1 | 74 | 77 | |
| Llama3-8B + DPOBase Model=Llama3-8B, Alignment=DPO, Length Constraint=Active2025.02 | 50.4 | 48 | 47.3 | 53.9 | 45.7 | 54.1 | 46.2 | 51.9 | 49.3 | |
| Llama3-3B + DPO-IterBase Model=Llama3-3B, Alignment=DPO-Iter, Length Constraint=Active2025.02 | 47.5 | 46.7 | 46.3 | 40.9 | 46.9 | 45.2 | 47.7 | 43.4 | 46.4 | |
| Llama3-3B + DPOBase Model=Llama3-3B, Alignment=DPO, Length Constraint=Active2025.02 | 36.8 | 38.1 | 35.6 | 37.4 | 42 | 39.7 | 30.8 | 37.9 | 37 | |
| Llama3-8BBase Model=Llama3-8B, Alignment=None, Length Constraint=Active2025.02 | 19.3 | 17.9 | 17.1 | 21.7 | 21 | 17.1 | 18.5 | 19.6 | 18.5 | |
| Llama3-3BBase Model=Llama3-3B, Alignment=None, Length Constraint=Active2025.02 | 15.1 | 15.5 | 15 | 15.7 | 13.6 | 13.7 | 9.2 | 15.3 | 15 |