Test-Time Personalization on Truthful QA
99.6Creative Win RateT-POP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| T-POPModel=Mistral-7B2025.09 | 99.6 | 95.4 | 72.3 | 96.5 | |
| AmuletModel=Llama-3.1-8B2025.09 | 99.5 | 93.2 | 85.5 | 92.8 | |
| T-POPModel=Qwen2-7B2025.09 | 98.5 | 96 | 79 | 99.1 | |
| T-POPModel=Llama-3.1-8B2025.09 | 97.3 | 95.4 | 68.8 | 93.5 | |
| LAModel=Llama-3.1-8B2025.09 | 97.2 | 96.5 | 74.7 | 95.3 | |
| LAModel=Mistral-7B2025.09 | 94.5 | 90.1 | 70.3 | 91.9 | |
| PrefModel=Llama-3.1-8B2025.09 | 94.1 | 87.3 | 71.9 | 82.7 | |
| AmuletModel=Mistral-7B2025.09 | 93.3 | 78.7 | 70.8 | 88.2 | |
| BS16Model=Llama-3.1-8B2025.09 | 92.3 | 86.7 | 76.9 | 82.6 | |
| PrefModel=Qwen2-7B2025.09 | 90.1 | 78.2 | 88.9 | 81.9 | |
| LAModel=Qwen2-7B2025.09 | 88.2 | 84.3 | 92.2 | 80.8 | |
| PrefModel=Mistral-7B2025.09 | 85.4 | 79.1 | 77.4 | 85.8 | |
| BS16Model=Qwen2-7B2025.09 | 85.4 | 79.5 | 90.1 | 81.2 | |
| AmuletModel=Qwen2-7B2025.09 | 83.9 | 78.9 | 91.2 | 93 | |
| BS16Model=Mistral-7B2025.09 | 83 | 77.5 | 80.5 | 82.9 |