Client Simulation on AnnoMI (test)
9.01PEBase
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| BaseDescription=Includes only the behavioral problem of client in the LLM prompt2025.02 | 9.01 | 16.17 | 12.15 | 9.3 | -0.31 | |
| Example-basedDescription=Provides a real counseling session exemplar involving the same client2025.02 | 53.68 | 45.73 | 45.55 | 33.53 | 0.25 | |
| Profile-basedDescription=Prompts the LLM to simulate the client based on the given client profile2025.02 | 61.97 | 53.44 | 67.17 | 54.67 | 0.31 | |
| Pro+Act-basedDescription=Provides both the client profile and description of actions in prompt2025.02 | 67.09 | 55.33 | 68.6 | 57.17 | 0.33 | |
| Consistent Client Simulation FrameworkDescription=Our method involving state control and information selection mechanism2025.02 | 70.57 | 73.37 | 71.7 | 68.51 | 0.58 |