Emotional Support Conversation on ExTES (test)
22.45BLEU-2AFlow
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| AFlowCategory=Ours2026.02 | 22.45 | 9.15 | 9.05 | 24.5 | 23.1 | 5.1 | 21.05 | 0.645 | 0.628 | |
| Multi AgentCategory=Sim, Values & Empathy2026.02 | 19.8 | 9.85 | 7.45 | 21.8 | 21.1 | 4.25 | 19.5 | 0.602 | 0.585 | |
| EmoDxCategory=Strat & Know.2026.02 | 19.5 | 10.1 | 7.35 | 21.5 | 20.9 | 4.35 | 19.1 | 0.608 | 0.589 | |
| DYN-KnCategory=Strat & Know.2026.02 | 19.2 | 10.3 | 7.1 | 21.1 | 20.5 | 4.2 | 18.8 | 0.595 | 0.578 | |
| Value ReinfCategory=Sim, Values & Empathy2026.02 | 19.1 | 9.9 | 6.95 | 20.5 | 20.8 | 4.15 | 18.5 | 0.595 | 0.571 | |
| Social SimCategory=Sim, Values & Empathy2026.02 | 18.5 | 10.2 | 6.8 | 20.9 | 20.1 | 4.1 | 17.8 | 0.588 | 0.562 | |
| IntentESCCategory=Task & Interp2026.02 | 18.2 | 10.5 | 6.15 | 20.2 | 19.5 | 3.85 | 16.5 | 0.582 | 0.565 | |
| ESCoTCategory=Task & Interp2026.02 | 17.5 | 11.2 | 5.35 | 19.5 | 18.8 | 3.65 | 15.8 | 0.555 | 0.532 | |
| Claude 3.5Category=General LLMs2026.02 | 16.5 | — | 7.25 | 20.8 | 23.5 | 4.85 | 23.8 | 0.605 | 0.588 | |
| GPT-4oCategory=General LLMs2026.02 | 15.8 | — | 6.55 | 19.2 | 23.8 | 4.05 | 21.8 | 0.578 | 0.548 | |
| KEMICategory=Strat & Know.2026.02 | 15.5 | 14.8 | 3.25 | 17.5 | 15.8 | 3.3 | 13.5 | 0.495 | 0.468 | |
| MISCCategory=Strat & Know.2026.02 | 13.8 | 15.6 | 2.75 | 16.1 | 14.5 | 2.95 | 11.8 | 0.451 | 0.418 | |
| BlenderBot-JointCategory=Task & Interp2026.02 | 11.5 | 16.5 | 2.25 | 16.5 | 13.2 | 1.75 | 6.85 | 0.305 | 0.268 | |
| MIMECategory=Sim, Values & Empathy2026.02 | 9.2 | — | 2.1 | 15.2 | 11.8 | 1.35 | 7.2 | — | — | |
| MoELCategory=Sim, Values & Empathy2026.02 | 8.5 | — | 1.85 | 14.5 | 11.2 | 1.25 | 6.5 | — | — |