Motivational Interviewing Global Score Prediction on AnnoMI (test)
2.85Cultivate ScoreHuman (High Quality)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human (High Quality)LLM Backbone=Human, Quality=HQ2025.02 | 2.85 | 2.88 | 2.97 | 3.49 | |
| CAMILLM Backbone=GPT-4o2025.02 | 2.62 | 2.86 | 2.58 | 3.37 | |
| Human (Low Quality)LLM Backbone=Human, Quality=LQ2025.02 | 2.43 | 2.47 | 2.26 | 2.45 | |
| CAMI-TELLM Backbone=GPT-4o2025.02 | 2.43 | 2.78 | 2.37 | 3.28 | |
| CoSLLM Backbone=GPT-4o2025.02 | 2.4 | 2.71 | 2.33 | 3.23 | |
| CAMILLM Backbone=Llama-3.1 70B2025.02 | 2.38 | 2.78 | 2.37 | 3.33 | |
| BaseLLM Backbone=GPT-4o2025.02 | 2.33 | 2.7 | 2.15 | 3.04 | |
| DIIRLLM Backbone=GPT-4o2025.02 | 2.21 | 2.64 | 2.37 | 3.1 | |
| CAMI-TELLM Backbone=Llama-3.1 70B2025.02 | 2.2 | 2.64 | 2.23 | 3.12 | |
| CoSLLM Backbone=Llama-3.1 70B2025.02 | 2.14 | 2.61 | 2.13 | 3.07 | |
| DIIRLLM Backbone=Llama-3.1 70B2025.02 | 2.13 | 2.57 | 2.28 | 2.87 | |
| BaseLLM Backbone=Llama-3.1 70B2025.02 | 2.1 | 2.34 | 2.08 | 2.57 |