Social Reasoning on Sotopia (all)
2.73Rel ScoreFT+MS
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FT+MSBackbone=Qwen2.5-7B2025.09 | 2.73 | 4.4 | 7.46 | 4.86 | |
| FT+MS+Uttr (TOMA)Backbone=Qwen2.5-7B2025.09 | 2.7 | 4.77 | 7.67 | 5.05 | |
| Base+MSBackbone=Qwen2.5-7B2025.09 | 2.47 | 4.45 | 7.3 | 4.74 | |
| FT+UttrBackbone=Qwen2.5-7B2025.09 | 2.42 | 4.78 | 7.43 | 4.88 | |
| FT+MSBackbone=Qwen2.5-3B2025.09 | 2.37 | 3.81 | 6.69 | 4.29 | |
| FT+MS+Uttr (TOMA)Backbone=Llama3.1-8B2025.09 | 2.37 | 5.61 | 7.48 | 5.15 | |
| FT+MS+Uttr (TOMA)Backbone=Qwen2.5-3B2025.09 | 2.18 | 4.22 | 6.84 | 4.41 | |
| BaseBackbone=Qwen2.5-7B2025.09 | 2.07 | 4.54 | 7.26 | 4.62 | |
| FT+UttrBackbone=Qwen2.5-3B2025.09 | 1.92 | 4.01 | 6.6 | 4.18 | |
| Base+MSBackbone=Qwen2.5-3B2025.09 | 1.54 | 3.48 | 5.93 | 3.65 | |
| FT+MSBackbone=Llama3.1-8B2025.09 | 1.49 | 4.7 | 6.46 | 4.22 | |
| FT+UttrBackbone=Llama3.1-8B2025.09 | 1.28 | 5.18 | 6.88 | 4.45 | |
| Base+MSBackbone=Llama3.1-8B2025.09 | 1.2 | 5.37 | 6.67 | 4.41 | |
| BaseBackbone=Qwen2.5-3B2025.09 | 0.97 | 3.29 | 5.25 | 3.17 | |
| BaseBackbone=Llama3.1-8B2025.09 | 0.27 | 5.09 | 6.11 | 3.82 |