Social Dialogue on SOTOPIA Overall (AVG)
5.63AVG ScoreLlama-8B+BC+SDPO
Evaluation results
| Method | Links | |
|---|---|---|
| Llama-8B+BC+SDPOAlignment=BC + Segment-Level Direct Preference Optimization2025.01 | 5.63 | |
| Llama-8B+BC+ETOAlignment=BC + ETO2025.01 | 5.45 | |
| Llama-8B+BC+DMPOAlignment=BC + DMPO2025.01 | 5.43 | |
| Llama-8B+BC+DPOAlignment=BC + DPO2025.01 | 5.34 | |
| GPT-4-turbo2025.01 | 5.32 | |
| GPT-4o2025.01 | 5.17 | |
| Llama-8B+BC+Preferred-SFTAlignment=BC + Preferred-SFT2025.01 | 5.17 | |
| Llama-8B+BCAlignment=Behavioral Cloning2025.01 | 5.16 | |
| Llama-8B2025.01 | 4.78 | |
| GPT-4o-mini2025.01 | 4.66 | |
| GPT-3.5-turbo2025.01 | 4.25 |