Self-correction on WikiText-2 and OpenWebText
82.2NLI ScoreOurs-0.6B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Ours-0.6BParameters=0.6B2026.05 | 82.2 | 1.182 | 89.9 | 143.7 | |
| Qwen2.5-1.5BParameters=1.5B, Type=Base2026.05 | 82.1 | 0.355 | 54.2 | 1,082.1 | |
| Qwen2.5-1.5B-InstructParameters=1.5B, Type=Instruct2026.05 | 70.3 | 1.742 | 89.7 | 173.9 |