Personalization on Ultra Chat
57Creative ArmoRM ScoreAmulet
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| AmuletBackbone=Llama-3.1-8B2025.09 | 57 | 41 | 53 | 48 | |
| T-POPBackbone=Llama-3.1-8B2025.09 | 50 | 49 | 60 | 52 | |
| T-POPBackbone=Mistral-7B2025.09 | 47 | 39 | 61 | 50 | |
| T-POPBackbone=Qwen2-7B2025.09 | 47 | 44 | 62 | 54 | |
| LABackbone=Llama-3.1-8B2025.09 | 42 | 36 | 48 | 44 | |
| AmuletBackbone=Mistral-7B2025.09 | 38 | 31 | 51 | 42 | |
| LABackbone=Mistral-7B2025.09 | 36 | 32 | 49 | 41 | |
| AmuletBackbone=Qwen2-7B2025.09 | 36 | 31 | 57 | 39 | |
| PrefBackbone=Mistral-7B2025.09 | 35 | 31 | 46 | 39 | |
| BS16Backbone=Mistral-7B2025.09 | 35 | 31 | 47 | 39 | |
| LABackbone=Qwen2-7B2025.09 | 35 | 32 | 54 | 40 | |
| BaseBackbone=Mistral-7B2025.09 | 34 | 31 | 45 | 38 | |
| BaseBackbone=Qwen2-7B2025.09 | 34 | 31 | 40 | 38 | |
| PrefBackbone=Qwen2-7B2025.09 | 34 | 32 | 45 | 39 | |
| BS16Backbone=Qwen2-7B2025.09 | 34 | 33 | 46 | 39 | |
| PrefBackbone=Llama-3.1-8B2025.09 | 34 | 32 | 41 | 38 | |
| BS16Backbone=Llama-3.1-8B2025.09 | 34 | 32 | 41 | 38 | |
| BaseBackbone=Llama-3.1-8B2025.09 | 33 | 31 | 38 | 37 |