Personality Alignment on IPIP-NEO-300
1.63AgreeablenessPPO
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| PPOBackbone=LLaMA-3-8B-Instruct2026.04 | 1.63 | 1.51 | 1.45 | 1.42 | 1.61 | 7.62 | |
| DPN-LEBackbone=LLaMA-3-8B-Instruct, gamma=12026.04 | 1.58 | 1.26 | 1.2 | 1.34 | 1.37 | 6.75 | |
| DPN-LEwBackbone=LLaMA-3-8B-Instruct, gamma=12026.04 | 1.58 | 1.26 | 1.2 | 1.23 | 1.37 | 6.64 | |
| DPOBackbone=LLaMA-3-8B-Instruct2026.04 | 1.54 | 1.42 | 1.54 | 1.74 | 1.21 | 7.45 | |
| P^2Backbone=GPT-4o2026.04 | 1.44 | 1.45 | 1.63 | 1.73 | 1.46 | 7.71 | |
| P^2Backbone=LLaMA-3-8B-Instruct2026.04 | 1.39 | 1.33 | 1.41 | 1.22 | 1.68 | 7.03 | |
| Few-ShotBackbone=LLaMA-3-8B-Instruct2026.04 | 1.28 | 1.3 | 1.4 | 1.09 | 0.89 | 5.96 | |
| Few-ShotBackbone=GPT-4o2026.04 | 1.02 | 0.83 | 0.81 | 0.8 | 0.96 | 4.42 | |
| PASBackbone=LLaMA-3-8B-Instruct2026.04 | 0.94 | 0.91 | 0.86 | 0.98 | 0.72 | 4.41 | |
| NPTIBackbone=LLaMA-3-8B-Instruct2026.04 | 0.78 | 0.75 | 0.68 | 0.68 | 0.61 | 3.5 |