Truthfulness Classification on TruthfulQA (held-out evaluation)
82AccuracyReal-time Hook
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Real-time HookModel=LLaMA 3-8B2026.03 | 82 | 86.25 | 90.55 | |
| BaselineModel=LLaMA 3-8B2026.03 | 81.33 | 81.25 | 91.59 | |
| Post-hoc MeanModel=LLaMA 3-8B2026.03 | 81.33 | 81.25 | 91.57 | |
| Post-hoc Pct80Model=LLaMA 3-8B2026.03 | 81.33 | 81.25 | 91.59 | |
| Post-hoc AmplifyModel=LLaMA 3-8B2026.03 | 81.33 | 81.25 | 91.55 | |
| Post-hoc FourierModel=LLaMA 3-8B2026.03 | 81.33 | 81.25 | 91.59 | |
| Post-hoc ZeroModel=LLaMA 3-8B2026.03 | 81.33 | 81.25 | 91.57 | |
| Real-time HookModel=Phi-3-mini2026.03 | 80 | 73.75 | 90.27 | |
| BaselineModel=Phi-3-mini2026.03 | 79.33 | 73.75 | 90.86 | |
| Post-hoc MeanModel=Phi-3-mini2026.03 | 79.33 | 73.75 | 90.8 | |
| Post-hoc Pct80Model=Phi-3-mini2026.03 | 79.33 | 73.75 | 90.86 | |
| Post-hoc AmplifyModel=Phi-3-mini2026.03 | 79.33 | 73.75 | 90.86 | |
| Post-hoc FourierModel=Phi-3-mini2026.03 | 79.33 | 73.75 | 90.86 | |
| Post-hoc ZeroModel=Phi-3-mini2026.03 | 79.33 | 73.75 | 90.86 | |
| Real-time HookModel=OPT-125M2026.03 | 71.33 | 78.75 | 80.91 | |
| BaselineModel=OPT-125M2026.03 | 69.33 | 71.25 | 78.59 | |
| Post-hoc MeanModel=OPT-125M2026.03 | 69.33 | 70 | 78.36 | |
| Post-hoc Pct80Model=OPT-125M2026.03 | 69.33 | 70 | 78.54 | |
| Post-hoc AmplifyModel=OPT-125M2026.03 | 69.33 | 70 | 78.38 | |
| Post-hoc FourierModel=OPT-125M2026.03 | 69.33 | 71.25 | 78.64 | |
| Post-hoc ZeroModel=OPT-125M2026.03 | 69.33 | 70 | 78.52 |