Counselor Competence Assessment on Counseling Dialogues (test)
4.77UnderstandingSTEPPERSFT + PREF.
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| STEPPERSFT + PREF.Planning=Yes, Preference Optimization=Yes2026.04 | 4.77 | 5.85 | 5.68 | 4.94 | 5.11 | 4.75 | 5.22 | 1.98 | |
| STEPPERSFTPlanning=Yes2026.04 | 4.7 | 5.81 | 5.62 | 5 | 5.01 | 4.69 | 5.36 | 2.06 | |
| CAMEL2026.04 | 4.51 | 5.75 | 5.48 | 4.63 | 4.73 | 4.49 | 4.69 | 1.88 | |
| LLAMA-PSYCH8K2026.04 | 4.01 | 5.74 | 5.62 | 4.58 | 4.66 | 4.59 | 3.77 | 1.62 | |
| STEPPERSFT_NOPLANPlanning=No2026.04 | 3.96 | 5.64 | 5.04 | 4.14 | 4.14 | 3.15 | 4.08 | 1.93 | |
| GEMINI-2.0-FLASH2026.04 | 3.78 | 5.23 | 4.35 | 3.73 | 3.81 | 3.35 | 2.82 | 1.42 | |
| GPT-4O2026.04 | 3.74 | 5.63 | 5.04 | 3.94 | 3.73 | 2.58 | 2.49 | 1.07 | |
| CBT-LLM2026.04 | 2.93 | 4.13 | 2.37 | 2.66 | 3.71 | 3.29 | 2.95 | 1.66 | |
| SMILECHAT2026.04 | 2.62 | 4.18 | 3.22 | 2.71 | 3.15 | 2.45 | 1.54 | 1.31 |