Reasoning on HellaSwag 10-shot
81.7Normalized Log AccuracyTülu
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Tülushot count=10-shot, DPO evaluation=true, backbone=Llama-3.1-Tulu-3-8B2026.03 | 81.7 | 4.66 | |
| HATified-SFTshots=10-shot2026.03 | 80.9 | — | |
| T-Freeshot count=10-shot, DPO evaluation=true2026.03 | 78.3 | 5.34 | |
| HATifiedshot count=10-shot, DPO evaluation=true2026.03 | 77.5 | 5.34 | |
| Llama-3.1-Tulu-3-8B-SFTshots=10, SFT=true2026.03 | 77.3 | 4.66 | |
| Llamashot count=10-shot, DPO evaluation=true, backbone=Llama-3.1-8B-Instruct2026.03 | 76.4 | 4.66 | |
| Llama-3.1-8B-TFree-HAT-SFTshots=10, SFT=true2026.03 | 74.7 | 5.34 | |
| Llama-Instructshots=10-shot2026.03 | 66.5 | — |