Personality Alignment Evaluation on Big Five Inventory (BFI) and Behavioral Tasks
3.61Knowledge Score (E)deepseek-v3.1
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| deepseek-v3.12026.05 | 3.61 | 2.71 | 0.91 | 4.8 | 3.49 | 1.31 | 4.11 | 3.81 | 0.3 | 2.42 | 3.04 | -0.62 | 4.92 | 4.34 | 0.57 | 0.749 | |
| qwen3-8b2026.05 | 3.58 | 3.19 | 0.39 | 3.5 | 3.95 | -0.45 | 3.5 | 3.25 | 0.25 | 2.67 | 2.97 | -0.3 | 3.33 | 4.13 | -0.8 | 0.234 | |
| claude-sonnet-4-62026.05 | 3.58 | 3.19 | 0.39 | 4.08 | 3.79 | 0.29 | 3.92 | 2.61 | 1.31 | 2.22 | 2.93 | -0.71 | 4.25 | 4.27 | -0.02 | 0.505 | |
| deepseek-v3.22026.05 | 3.56 | 3.09 | 0.47 | 4.69 | 3.36 | 1.33 | 4.19 | 3.87 | 0.32 | 2.45 | 3.16 | -0.71 | 4.89 | 4.42 | 0.47 | 0.591 | |
| qwen3-32b2026.05 | 3.56 | 2.68 | 0.88 | 4.33 | 3.75 | 0.58 | 4.05 | 3.53 | 0.52 | 2.03 | 3.56 | -1.53 | 3.42 | 4.13 | -0.71 | 0.849 | |
| glm-52026.05 | 3.56 | 2.82 | 0.74 | 4.89 | 3.95 | 0.94 | 4.97 | 3.76 | 1.21 | 1.08 | 3.39 | -2.31 | 4.89 | 4.19 | 0.7 | 1.789 | |
| gemini-3.1-pro2026.05 | 3.42 | 1.91 | 1.51 | 4.53 | 3.54 | 0.98 | 4.75 | 3.54 | 1.21 | 1.89 | 3.56 | -1.67 | 4.75 | 3.67 | 1.08 | 1.834 | |
| minimax-m2.52026.05 | 3.33 | 3.32 | 0.01 | 4.58 | 2.51 | 2.07 | 4.45 | 2.92 | 1.53 | 1.36 | 2.95 | -1.59 | 4.47 | 3.35 | 1.12 | 2.17 | |
| gpt-4o2026.05 | 3.19 | 2.72 | 0.47 | 3.72 | 3.49 | 0.23 | 3.72 | 3.06 | 0.67 | 2.55 | 3.33 | -0.78 | 4.25 | 4.42 | -0.17 | 0.283 | |
| qwen3-235b-thinking2026.05 | 3.14 | 3.09 | 0.05 | 4.61 | 3.28 | 1.33 | 4.61 | 3.02 | 1.6 | 1.44 | 3.23 | -1.79 | 3.61 | 3.72 | -0.11 | 1.541 | |
| deepseek-v32026.05 | 3.11 | 2.72 | 0.39 | 3.44 | 4.03 | -0.59 | 3.39 | 3.18 | 0.21 | 2.67 | 2.99 | -0.32 | 3.25 | 4.32 | -1.07 | 0.471 | |
| deepseek-v4-flash2026.05 | 3.11 | 3.27 | -0.16 | 3.94 | 3.41 | 0.53 | 3.86 | 3.1 | 0.76 | 2.39 | 3.58 | -1.19 | 3.53 | 4.06 | -0.54 | 0.654 | |
| deepseek-v4-pro2026.05 | 3.09 | 2.97 | 0.12 | 3.58 | 3.62 | -0.04 | 3.83 | 3.02 | 0.81 | 2.11 | 3.4 | -1.29 | 3.69 | 4.25 | -0.55 | 0.574 | |
| qwen3-1.7b2026.05 | 3.08 | 3.21 | -0.13 | 3 | 2.96 | 0.04 | 3 | 2.82 | 0.18 | 3 | 2.49 | 0.51 | 3.17 | 3.8 | -0.63 | 0.189 | |
| Human Baseline2026.05 | 2.86 | 2.72 | 0.14 | 3.59 | 3.5 | 0.09 | 3.19 | 3.01 | 0.18 | 2.82 | 2.89 | -0.08 | 3.74 | 3.8 | -0.07 | 0.445 |