Combinatorial Reasoning on Sudoku 4x4
100Accuracyo1-preview
Evaluation Results
| Method | Links | |
|---|---|---|
| o1-previewAlgorithm=API, Model=o1-preview2025.03 | 100 | |
| DeepSeek-R1Algorithm=API, Model=DeepSeek-R12025.03 | 100 | |
| o4-miniAlgorithm=API, Model=o4-mini2025.03 | 100 | |
| SEM-CTRLAlgorithm=SEM-CTRL, Model=Llama 1B2025.03 | 100 | |
| SEM-CTRLAlgorithm=SEM-CTRL, Model=Llama 70B2025.03 | 100 | |
| BoNAlgorithm=BoN, Model=Llama 70B2025.03 | 80 | |
| BaseAlgorithm=Base, Model=Llama 70B2025.03 | 30 | |
| BaseAlgorithm=Base, Model=Llama 1B2025.03 | 0 | |
| BoNAlgorithm=BoN, Model=Llama 1B2025.03 | 0 |