Science Question Answering on ARC Easy (Accuracy, AVG, Delta)
83.9AccuracyQwen 8B (w/ LoopUS)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen 8B (w/ LoopUS)Model=Qwen 8B, Setting=w/ LoopUS, Evaluation protocol=zero-shot2026.05 | 83.9 | 65.4 | 2.2 | |
| Phi-4 14B (w/ LoopUS)Model=Phi-4 14B, Setting=w/ LoopUS, Evaluation protocol=zero-shot2026.05 | 83.5 | 68.6 | 1.7 | |
| Qwen 8B (w/o LoopUS)Model=Qwen 8B, Setting=w/o LoopUS, Evaluation protocol=zero-shot2026.05 | 81.5 | 63.2 | — | |
| Qwen 4B (w/ LoopUS)Model=Qwen 4B, Setting=w/ LoopUS, Evaluation protocol=zero-shot2026.05 | 81.3 | 62.1 | 1.8 | |
| Phi-4 14B (w/o LoopUS)Model=Phi-4 14B, Setting=w/o LoopUS, Evaluation protocol=zero-shot2026.05 | 81.3 | 67 | — | |
| Qwen 4B (w/o LoopUS)Model=Qwen 4B, Setting=w/o LoopUS, Evaluation protocol=zero-shot2026.05 | 80.2 | 60.3 | — | |
| Qwen 1.7B (w/ LoopUS)Model=Qwen 1.7B, Setting=w/ LoopUS, Evaluation protocol=zero-shot2026.05 | 74.9 | 55.3 | 1.6 | |
| Qwen 1.7B (w/o LoopUS)Model=Qwen 1.7B, Setting=w/o LoopUS, Evaluation protocol=zero-shot2026.05 | 72.5 | 53.7 | — |