Emotional Support on BOLT SMS single-turn
66.45T-StatisticSTAR
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| STARComparison=Steer vs. Baseline, Feature group=Empathy, Feature=Speaking2025.11 | 66.45 | — | — | — | — | — | — | — | — | — | 47 | — | — | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Politeness, Feature=Listen2025.11 | 63.81 | — | — | — | — | — | — | — | — | — | — | 32 | — | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Empathy, Feature=Communication2025.11 | 63.23 | — | — | — | — | — | — | — | — | 48 | — | — | — | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Pronouns, Feature=1st-person2025.11 | 54.05 | — | — | — | — | — | — | 50 | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Emotion, Feature=Anticipation2025.11 | 40.9 | — | — | — | — | — | 18 | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Emotion, Feature=Joy2025.11 | 34.09 | 14 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Emotion, Feature=Trust2025.11 | 33.81 | — | 13 | — | — | — | — | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Emotion, Feature=Fear2025.11 | 27.78 | — | — | — | 6 | — | — | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Emotion, Feature=Sadness2025.11 | 26.09 | — | — | — | — | 7 | — | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Emotion, Feature=Anger2025.11 | 25.01 | — | — | 5 | — | — | — | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Politeness, Feature=Strength2025.11 | 14.41 | — | — | — | — | — | — | — | — | — | — | — | 1 | — | — | |
| STARComparison=Steer vs. Baseline, Feature group=Politeness, Feature=Healing2025.11 | 11.99 | — | — | — | — | — | — | — | — | — | — | — | — | 1 | — | |
| STARComparison=Steer vs. Baseline, Feature group=Politeness, Feature=Nervousness2025.11 | 11.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | 1 | |
| STARComparison=Steer vs. Unsteer, Feature group=Pronouns, Feature=1st-person2025.11 | 3.86 | — | — | — | — | — | — | 50 | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Empathy, Feature=Communication2025.11 | 2.56 | — | — | — | — | — | — | — | — | 48 | — | — | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Politeness, Feature=Listen2025.11 | 2.55 | — | — | — | — | — | — | — | — | — | — | 32 | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Emotion, Feature=Joy2025.11 | 2.16 | 14 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Empathy, Feature=Speaking2025.11 | 2.13 | — | — | — | — | — | — | — | — | — | 47 | — | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Emotion, Feature=Fear2025.11 | 2.06 | — | — | — | 6 | — | — | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Emotion, Feature=Trust2025.11 | 1.92 | — | 13 | — | — | — | — | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Emotion, Feature=Anticipation2025.11 | 1.85 | — | — | — | — | — | 18 | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Emotion, Feature=Sadness2025.11 | 1.68 | — | — | — | — | 7 | — | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Politeness, Feature=Strength2025.11 | 1.27 | — | — | — | — | — | — | — | — | — | — | — | 1 | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Empathy, Feature=Help2025.11 | 1.26 | — | — | — | — | — | — | — | 1 | — | — | — | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Politeness, Feature=Nervousness2025.11 | 1.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | 1 | |
| STARComparison=Steer vs. Unsteer, Feature group=Emotion, Feature=Anger2025.11 | 0.9 | — | — | 5 | — | — | — | — | — | — | — | — | — | — | — | |
| STARComparison=Steer vs. Unsteer, Feature group=Politeness, Feature=Healing2025.11 | 0.79 | — | — | — | — | — | — | — | — | — | — | — | — | 1 | — | |
| STARComparison=Steer vs. Baseline, Feature group=Empathy, Feature=Help2025.11 | 0.53 | — | — | — | — | — | — | — | 1 | — | — | — | — | — | — | |
| BaselineComparison=vs. STAR, Context=Support, Setting=Single-turn2025.11 | — | 2 | 2 | 1 | 1 | 1 | 1 | 3 | 1 | 5 | 5 | 3 | 1 | 1 | 1 | |
| UnsteeredComparison=vs. STAR, Context=Support, Setting=Single-turn2025.11 | — | 13 | 12 | 5 | 6 | 7 | 17 | 45 | 1 | 46 | 45 | 30 | 1 | 1 | 1 |