Truthful Question Answering on TruthfulQA (Accuracy, AR%)
54.8AccuracyTeacher (Qwen3-4B)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Teacher (Qwen3-4B)Precision=BF162026.06 | 54.8 | — | |
| Recover-LoRA (Synthetic-10k)Recovery Training Dataset=Synthetic-10k, Quantization=W2-GateUp2026.06 | 54.2 | 90.7 | |
| Recover-LoRA (OpenHermes-10k)Recovery Training Dataset=OpenHermes-10k, Quantization=W2-GateUp2026.06 | 53.3 | 75.6 | |
| Quantized Student (Qwen3-4B)Quantization=W2-GateUp (gate/up at INT2, remaining at BF16)2026.06 | 48.7 | — |