Social Dialogue on SOTOPIA Interaction with GPT-4o
8.21Goal ScoreLLaMA-8B+BC+ALPO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LLaMA-8B+BC+ALPOBackbone=LLaMA-8B, Alignment=ALPO, Interaction Partner=GPT-4o2026.02 | 8.21 | 3.19 | |
| SDPOBase Model=Mistral-v0.32025.01 | 8.14 | 3.06 | |
| Llama-8B+BC+SDPOAlignment=BC + Segment-Level Direct Preference Optimization2025.01 | 8.13 | 3.16 | |
| LLaMA-8B+BC+SDPOBackbone=LLaMA-8B, Alignment=SDPO, Interaction Partner=GPT-4o2026.02 | 8.13 | 3.16 | |
| Llama-8B+BC+ETOAlignment=BC + ETO2025.01 | 8.02 | 3.03 | |
| LLaMA-8B+BC+ETOBackbone=LLaMA-8B, Alignment=ETO, Interaction Partner=GPT-4o2026.02 | 8.02 | 3.03 | |
| Llama-8B+BC+DMPOAlignment=BC + DMPO2025.01 | 8 | 2.98 | |
| LLaMA-8B+BC+DMPOBackbone=LLaMA-8B, Alignment=DMPO, Interaction Partner=GPT-4o2026.02 | 8 | 2.98 | |
| DMPOBase Model=Mistral-v0.32025.01 | 7.97 | 2.94 | |
| ETOBase Model=Mistral-v0.32025.01 | 7.94 | 2.94 | |
| GPT-4-turbo2025.01 | 7.92 | 2.79 | |
| GPT-4-turboInteraction Partner=GPT-4o2026.02 | 7.92 | 2.79 | |
| GPT-4o2025.01 | 7.9 | 2.67 | |
| GPT-4oInteraction Partner=GPT-4o2026.02 | 7.9 | 2.67 | |
| DPOBase Model=Mistral-v0.32025.01 | 7.83 | 2.86 | |
| Llama-8B+BC+DPOAlignment=BC + DPO2025.01 | 7.8 | 2.97 | |
| LLaMA-8B+BC+DPOBackbone=LLaMA-8B, Alignment=DPO, Interaction Partner=GPT-4o2026.02 | 7.8 | 2.97 | |
| Llama-8B2025.01 | 7.7 | 2.49 | |
| LLaMA-8BBackbone=LLaMA-8B, Interaction Partner=GPT-4o2026.02 | 7.7 | 2.49 | |
| Llama-8B+BC+Preferred-SFTAlignment=BC + Preferred-SFT2025.01 | 7.65 | 2.88 | |
| LLaMA-8B+BC+Preferred-SFTBackbone=LLaMA-8B, Training=BC + Preferred-SFT, Interaction Partner=GPT-4o2026.02 | 7.65 | 2.88 | |
| BCBase Model=Mistral-v0.32025.01 | 7.6 | 2.81 | |
| Llama-8B+BCAlignment=Behavioral Cloning2025.01 | 7.53 | 2.78 | |
| LLaMA-8B+BCBackbone=LLaMA-8B, Training=Behavioral Cloning, Interaction Partner=GPT-4o2026.02 | 7.53 | 2.78 | |
| GPT-4o-mini2025.01 | 7.44 | 2.36 | |
| GPT-4o-miniInteraction Partner=GPT-4o2026.02 | 7.44 | 2.36 | |
| GPT-3.5-turbo2025.01 | 7.19 | 2.05 | |
| GPT-3.5-turboInteraction Partner=GPT-4o2026.02 | 7.19 | 2.05 |