Commonsense Reasoning on HellaSwag (Accuracy, AVG, Delta)
63.1AccuracyPhi-4 14B (w/o LoopUS)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Phi-4 14B (w/o LoopUS)Model=Phi-4 14B, Setting=w/o LoopUS, Evaluation protocol=zero-shot2026.05 | 63.1 | 67 | — | |
| Phi-4 14B (w/ LoopUS)Model=Phi-4 14B, Setting=w/ LoopUS, Evaluation protocol=zero-shot2026.05 | 60.58 | 68.6 | 1.7 | |
| Qwen 8B (w/o LoopUS)Model=Qwen 8B, Setting=w/o LoopUS, Evaluation protocol=zero-shot2026.05 | 57.2 | 63.2 | — | |
| Qwen 8B (w/ LoopUS)Model=Qwen 8B, Setting=w/ LoopUS, Evaluation protocol=zero-shot2026.05 | 56 | 65.4 | 2.2 | |
| Qwen 4B (w/o LoopUS)Model=Qwen 4B, Setting=w/o LoopUS, Evaluation protocol=zero-shot2026.05 | 52.1 | 60.3 | — | |
| Qwen 4B (w/ LoopUS)Model=Qwen 4B, Setting=w/ LoopUS, Evaluation protocol=zero-shot2026.05 | 51.4 | 62.1 | 1.8 | |
| Qwen 1.7B (w/ LoopUS)Model=Qwen 1.7B, Setting=w/ LoopUS, Evaluation protocol=zero-shot2026.05 | 46.3 | 55.3 | 1.6 | |
| Qwen 1.7B (w/o LoopUS)Model=Qwen 1.7B, Setting=w/o LoopUS, Evaluation protocol=zero-shot2026.05 | 46.2 | 53.7 | — |