Persona Simulation on PersonaChat
100Adherence ScorePersonaChat
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PersonaChat2026.03 | 100 | — | — | 100 | — | — | 100 | — | — | 100 | — | — | |
| Gemma 3 12B2026.03 | 98.3 | -1.7 | 1 | 87.7 | -12.28 | 8 | 95.3 | -4.66 | 3 | 93.8 | -6.23 | 2 | |
| Qwen3 30B2026.03 | 97.4 | -2.57 | 2 | 91.7 | -8.3 | 6 | 96 | -4.02 | 1 | 95 | -4.96 | 1 | |
| Gemma 3 27B2026.03 | 97 | -3 | 3 | 87.4 | -12.63 | 9 | 91.5 | -8.5 | 7 | 92 | -8.03 | 6 | |
| Gemma 3 4B2026.03 | 94.8 | -5.17 | 4 | 90.1 | -9.86 | 7 | 95.6 | -4.39 | 2 | 93.5 | -6.49 | 3 | |
| Qwen3 14B2026.03 | 91.9 | -8.11 | 6 | 97.6 | -2.42 | 1 | 88.3 | -11.66 | 9 | 92.6 | -7.4 | 5 | |
| Gemma 3 1B2026.03 | 91.8 | -8.07 | 5 | 86.7 | -13.32 | 10 | 94.7 | -5.35 | 4 | 91.1 | -8.89 | 7 | |
| Qwen3 4B2026.03 | 91.2 | -8.84 | 7 | 94.6 | -5.36 | 4 | 94.6 | -5.35 | 5 | 93.4 | -6.55 | 4 | |
| Qwen3 1.7B2026.03 | 84 | -16.01 | 8 | 91.9 | -8.13 | 5 | 92.7 | -7.27 | 6 | 89.5 | -10.47 | 8 | |
| SPC-New2026.03 | 83.7 | -16.3 | 9 | 95.3 | -4.67 | 3 | 86.4 | -13.58 | 10 | 88.5 | -11.53 | 10 | |
| SPC2026.03 | 81.1 | -18.93 | 10 | 95.5 | -4.5 | 2 | 89.7 | -10.29 | 8 | 88.8 | -11.24 | 9 |