Commonsense Reasoning on HellaSwag (NLL)
0.58NLLBase + TS
Evaluation Results
| Method | Links | |
|---|---|---|
| Base + TSBackbone=QWEN2-7B, Temperature Scaling=true2026.05 | 0.58 | |
| PPT (Distribution)Backbone=QWEN2-7B, Temperature Scaling=false2026.05 | 0.6 | |
| PPT (Distribution) + TSBackbone=QWEN2-7B, Temperature Scaling=true2026.05 | 0.6 | |
| PPT (Mean)Backbone=QWEN2-7B, Temperature Scaling=false2026.05 | 0.75 | |
| BaseBackbone=QWEN2-7B, Temperature Scaling=false2026.05 | 0.84 | |
| PPT (Distribution) + TSBackbone=LLAMA3-8B, Temperature Scaling=true2026.05 | 0.87 | |
| PPT (Distribution)Backbone=LLAMA3-8B, Temperature Scaling=false2026.05 | 0.88 | |
| Base + TSBackbone=LLAMA3-8B, Temperature Scaling=true2026.05 | 0.95 | |
| PPT (Mean)Backbone=LLAMA3-8B, Temperature Scaling=false2026.05 | 0.98 | |
| BaseBackbone=LLAMA3-8B, Temperature Scaling=false2026.05 | 1.26 |