Social Dialogue on SOTOPIA Interaction with GPT-4o-mini
7.53GOAL ScoreGPT-4-turbo
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4-turbo2025.01 | 7.53 | 2.54 | |
| Llama-8B+BC+SDPOAlignment=BC + Segment-Level Direct Preference Optimization2025.01 | 7.53 | 2.71 | |
| GPT-4o2025.01 | 7.47 | 2.4 | |
| Llama-8B+BC+DMPOAlignment=BC + DMPO2025.01 | 7.41 | 2.54 | |
| Llama-8B+BC+ETOAlignment=BC + ETO2025.01 | 7.38 | 2.56 | |
| Llama-8B+BC+DPOAlignment=BC + DPO2025.01 | 7.32 | 2.7 | |
| Llama-8B2025.01 | 7.19 | 2.13 | |
| Llama-8B+BCAlignment=Behavioral Cloning2025.01 | 7.18 | 2.59 | |
| Llama-8B+BC+Preferred-SFTAlignment=BC + Preferred-SFT2025.01 | 7.18 | 2.52 | |
| GPT-4o-mini2025.01 | 6.98 | 2.11 | |
| GPT-3.5-turbo2025.01 | 6.67 | 1.84 |