Preference Modeling on BT
1.08NLLPPT (Distribution) + TS
Evaluation Results
| Method | Links | |
|---|---|---|
| PPT (Distribution) + TSBackbone=LLAMA3-8B, Temperature Scaling=true2026.05 | 1.08 | |
| PPT (Distribution) + TSBackbone=QWEN2-7B, Temperature Scaling=true2026.05 | 1.09 | |
| PPT (Distribution)Backbone=LLAMA3-8B, Temperature Scaling=false2026.05 | 1.25 | |
| PPT (Distribution)Backbone=QWEN2-7B, Temperature Scaling=false2026.05 | 1.4 | |
| PPT (Mean)Backbone=LLAMA3-8B, Temperature Scaling=false2026.05 | 1.86 | |
| PPT (Mean)Backbone=QWEN2-7B, Temperature Scaling=false2026.05 | 2.06 | |
| BaseBackbone=QWEN2-7B, Temperature Scaling=false2026.05 | 2.56 | |
| BaseBackbone=LLAMA3-8B, Temperature Scaling=false2026.05 | 2.91 |