Personalization on HelpSteer
0.51Creative ArmoRM ScoreT-POP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| T-POPBackbone=Llama-3.1-8B2025.09 | 0.51 | 0.51 | 0.62 | 0.53 | |
| T-POPBackbone=Qwen2-7B2025.09 | 0.5 | 0.44 | 0.6 | 0.52 | |
| AmuletBackbone=Llama-3.1-8B2025.09 | 0.5 | 0.41 | 0.57 | 0.5 | |
| T-POPBackbone=Mistral-7B2025.09 | 0.48 | 0.4 | 0.59 | 0.5 | |
| LABackbone=Llama-3.1-8B2025.09 | 0.44 | 0.36 | 0.53 | 0.45 | |
| AmuletBackbone=Mistral-7B2025.09 | 0.39 | 0.3 | 0.52 | 0.41 | |
| LABackbone=Mistral-7B2025.09 | 0.36 | 0.31 | 0.52 | 0.4 | |
| AmuletBackbone=Qwen2-7B2025.09 | 0.36 | 0.3 | 0.59 | 0.41 | |
| BS16Backbone=Llama-3.1-8B2025.09 | 0.36 | 0.33 | 0.45 | 0.39 | |
| BS16Backbone=Qwen2-7B2025.09 | 0.35 | 0.33 | 0.5 | 0.39 | |
| LABackbone=Qwen2-7B2025.09 | 0.35 | 0.33 | 0.57 | 0.39 | |
| BS16Backbone=Mistral-7B2025.09 | 0.34 | 0.31 | 0.5 | 0.39 | |
| BaseBackbone=Qwen2-7B2025.09 | 0.34 | 0.31 | 0.43 | 0.38 | |
| PrefBackbone=Qwen2-7B2025.09 | 0.34 | 0.32 | 0.48 | 0.38 | |
| PrefBackbone=Llama-3.1-8B2025.09 | 0.34 | 0.31 | 0.43 | 0.37 | |
| BaseBackbone=Llama-3.1-8B2025.09 | 0.33 | 0.3 | 0.4 | 0.36 | |
| BaseBackbone=Mistral-7B2025.09 | 0.3 | 0.27 | 0.41 | 0.33 | |
| PrefBackbone=Mistral-7B2025.09 | 0.3 | 0.27 | 0.42 | 0.33 |