Truthfulness Evaluation on TruthfulQA (NLL)
1.62NLLPPT (Distribution) + TS
Evaluation results
| Method | Links | |
|---|---|---|
| PPT (Distribution) + TSBackbone=LLAMA3-8B, Temperature Scaling=true2026.05 | 1.62 | |
| Base + TSBackbone=LLAMA3-8B, Temperature Scaling=true2026.05 | 1.76 | |
| PPT (Distribution)Backbone=LLAMA3-8B, Temperature Scaling=false2026.05 | 1.78 | |
| PPT (Mean)Backbone=LLAMA3-8B, Temperature Scaling=false2026.05 | 2.36 | |
| PPT (Distribution)Backbone=QWEN2-7B, Temperature Scaling=false2026.05 | 3.04 | |
| PPT (Distribution) + TSBackbone=QWEN2-7B, Temperature Scaling=true2026.05 | 3.16 | |
| BaseBackbone=LLAMA3-8B, Temperature Scaling=false2026.05 | 3.49 | |
| PPT (Mean)Backbone=QWEN2-7B, Temperature Scaling=false2026.05 | 4.48 | |
| BaseBackbone=QWEN2-7B, Temperature Scaling=false2026.05 | 4.81 | |
| Base + TSBackbone=QWEN2-7B, Temperature Scaling=true2026.05 | 4.81 |