Test-Time Personalization on HelpSteer
99.5Creative Win RateT-POP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| T-POPModel=Mistral-7B2025.09 | 99.5 | 93.1 | 92.4 | 97.2 | |
| T-POPModel=Llama-3.1-8B2025.09 | 98.6 | 97.6 | 92.3 | 97.6 | |
| LAModel=Mistral-7B2025.09 | 98.1 | 91 | 87.9 | 95.3 | |
| AmuletModel=Llama-3.1-8B2025.09 | 97.6 | 94.7 | 86.3 | 97.5 | |
| PrefModel=Llama-3.1-8B2025.09 | 97.4 | 91.7 | 89 | 89.4 | |
| LAModel=Llama-3.1-8B2025.09 | 97.4 | 97.6 | 94.3 | 99 | |
| T-POPModel=Qwen2-7B2025.09 | 96.6 | 94 | 92 | 98.2 | |
| BS16Model=Llama-3.1-8B2025.09 | 96.2 | 91.4 | 89.3 | 88.8 | |
| PrefModel=Mistral-7B2025.09 | 95.5 | 79.4 | 87.9 | 86.7 | |
| BS16Model=Mistral-7B2025.09 | 94 | 76.5 | 89.5 | 85.2 | |
| PrefModel=Qwen2-7B2025.09 | 94 | 93.2 | 88.2 | 83.8 | |
| BS16Model=Qwen2-7B2025.09 | 92.8 | 90.9 | 89.5 | 83.5 | |
| AmuletModel=Mistral-7B2025.09 | 90.2 | 79.7 | 75.1 | 92.3 | |
| AmuletModel=Qwen2-7B2025.09 | 89.9 | 83.3 | 91.6 | 97.7 | |
| LAModel=Qwen2-7B2025.09 | 86.1 | 82.9 | 92.8 | 75.2 |