Multi-turn Psychological Counseling Dialogue Generation on CPsyCoun
36.03ROUGE-1PsyDTLLM
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| PsyDTLLMModel Type=Our2024.12 | 36.03 | 10.08 | 28.86 | 9.99 | 96.79 | 1.9 | 2.13 | 2.19 | 2.26 | 1 | |
| ChatGPTModel Type=Closed2024.12 | 31.72 | 7.77 | 24.52 | 7.24 | 96.69 | 1.7 | 1.74 | 1.88 | 1.99 | 1 | |
| MeChatModel Type=Domain2024.12 | 30.71 | 7.05 | 24.43 | 6.73 | 96.55 | 1.54 | 1.58 | 1.66 | 1.96 | 1 | |
| Llama3.1-8B-InstructModel Type=Open2024.12 | 30.2 | 5.84 | 22.88 | 5.96 | 96.54 | 1.61 | 1.7 | 1.81 | 1.9 | 1 | |
| Yi-1.5-9B-ChatModel Type=Open2024.12 | 29.32 | 6.89 | 21.85 | 7.5 | 96.66 | 1.75 | 1.79 | 2.11 | 1.93 | 1 | |
| SoulChatModel Type=Domain2024.12 | 28.93 | 5.93 | 23.26 | 5.49 | 96.42 | 1.29 | 1.36 | 1.42 | 1.76 | 1 | |
| PsyChatModel Type=Domain2024.12 | 27.96 | 5.21 | 21.44 | 4.83 | 96.19 | 1.36 | 1.4 | 1.34 | 1.79 | 1 | |
| InternLM2-Chat-7BModel Type=Open2024.12 | 27.15 | 5.87 | 20.38 | 5.49 | 96.62 | 1.87 | 1.92 | 2.04 | 2.05 | 1 | |
| GPT-4Model Type=Closed2024.12 | 26.51 | 6.79 | 18.23 | 5.31 | 96.59 | 1.8 | 1.99 | 2.06 | 1.89 | 1 | |
| Llama3-8B-InstructModel Type=Open2024.12 | 26.31 | 5.25 | 19.64 | 5.11 | 95.16 | 1.58 | 1.72 | 1.77 | 1.81 | 1 | |
| CPsyCounXModel Type=Domain2024.12 | 23.71 | 4.32 | 17.59 | 3.59 | 95.46 | 1.28 | 1.42 | 1.54 | 1.6 | 1 | |
| Qwen2-7B-InstructModel Type=Open2024.12 | 23.42 | 5.28 | 15.42 | 4.05 | 96.64 | 1.81 | 2.09 | 2.18 | 2.12 | 1 | |
| GLM4-9B-ChatModel Type=Open2024.12 | 23.38 | 5.45 | 14.35 | 3.84 | 96.58 | 1.68 | 1.88 | 1.94 | 1.74 | 1 | |
| EmoLLMModel Type=Domain2024.12 | 23.26 | 4.01 | 18.5 | 3.74 | 91.74 | 1.06 | 1.18 | 1.21 | 1.36 | 1 | |
| MindChatModel Type=Domain2024.12 | 22.55 | 3.44 | 17.75 | 3.48 | 93.89 | 1.13 | 1.25 | 1.13 | 1.54 | 1 | |
| Baichuan2-7B-ChatModel Type=Open2024.12 | 15.4 | 3.69 | 11.84 | 3.46 | 94.14 | 1.35 | 1.34 | 1.44 | 1.49 | 1 |