Puzzle Solving on Sudoku (Test accuracy (%))
27.2Test AccuracyPAPO
Evaluation Results
| Method | Links | |
|---|---|---|
| PAPOSeq Len=128, SFT=false2026.06 | 27.2 | |
| StableDRLGeneration Length=2562026.05 | 25.39 | |
| PAPOSeq Len=256, SFT=false2026.06 | 25 | |
| UniGRPO†Seq Len=128, SFT=false2026.06 | 23.9 | |
| SPGGeneration Length=5122026.05 | 23.83 | |
| StableDRLGeneration Length=5122026.05 | 23.83 | |
| SPGGeneration Length=2562026.05 | 23.44 | |
| wd1Generation Length=2562026.05 | 23.05 | |
| wd1Generation Length=5122026.05 | 23.05 | |
| SAPOSeq Len=128, SFT=false2026.06 | 22.4 | |
| SFT + diffu-GRPOSeq Len=128, SFT=true2026.06 | 22.1 | |
| ESPOGeneration Length=2562026.05 | 20.31 | |
| SAPOSeq Len=256, SFT=false2026.06 | 20.3 | |
| PAPOSeq Len=512, SFT=false2026.06 | 20.2 | |
| ESPOGeneration Length=5122026.05 | 19.53 | |
| UniGRPO†Seq Len=256, SFT=false2026.06 | 19.2 | |
| diffu-GRPOSeq Len=128, SFT=false2026.06 | 18.4 | |
| d1Generation Length=5122026.05 | 18.36 | |
| SFT + diffu-GRPOSeq Len=256, SFT=true2026.06 | 16.7 | |
| SFTSeq Len=128, SFT=true2026.06 | 16.5 | |
| SAPOSeq Len=512, SFT=false2026.06 | 16.1 | |
| d1Generation Length=2562026.05 | 15.23 | |
| WINOSeq Len=256, SFT=false2026.06 | 15.2 | |
| UniGRPO†Seq Len=512, SFT=false2026.06 | 14.1 | |
| Diffu-GRPOGeneration Length=2562026.05 | 13.67 | |
| diffu-GRPOSeq Len=256, SFT=false2026.06 | 12.9 | |
| Diffu-GRPOGeneration Length=5122026.05 | 12.11 | |
| LLaDA-8B-InstructSeq Len=128, SFT=false2026.06 | 11.7 | |
| diffu-GRPOSeq Len=512, SFT=false2026.06 | 11 | |
| GDPOGeneration Length=5122026.05 | 10.55 | |
| GDPOGeneration Length=2562026.05 | 9.77 | |
| SFT + diffu-GRPOSeq Len=512, SFT=true2026.06 | 9.5 | |
| SFTSeq Len=256, SFT=true2026.06 | 8.5 | |
| LLaDA-8B-InstructGeneration Length=5122026.05 | 8.2 | |
| SFTGeneration Length=2562026.05 | 8.2 | |
| LLaDA-8B-InstructGeneration Length=2562026.05 | 7.81 | |
| AdaBlock-dLLMGeneration Length=5122026.05 | 7.81 | |
| SFTGeneration Length=5122026.05 | 7.03 | |
| LLaDA-8B-InstructSeq Len=256, SFT=false2026.06 | 6.7 | |
| AdaBlock-dLLMGeneration Length=2562026.05 | 6.64 | |
| LLaDA-8B-InstructSeq Len=512, SFT=false2026.06 | 5.5 | |
| SFTSeq Len=512, SFT=true2026.06 | 4.6 |