Persona Adherence Alignment on PersonaChat 1.0 (test)
100SimilarityPersonaChat
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PersonaChatAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 100 | 0 | |
| Gemma 3 12BAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 98.3 | -1.7 | |
| Qwen3 30BAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 97.4 | -2.57 | |
| Gemma 3 27BAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 97 | -3 | |
| Gemma 3 4BAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 94.8 | -5.17 | |
| Qwen3 14BAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 91.9 | -8.11 | |
| Gemma 3 1BAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 91.8 | -8.07 | |
| Qwen3 4BAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 91.2 | -8.84 | |
| Qwen3 1.7BAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 84 | -16.01 | |
| SPC-NewAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 83.7 | -16.3 | |
| SPCAlpha (α) configuration=1.0, Target-speaker configuration=target-speaker only2026.03 | 81.1 | -18.93 |