Constraint Satisfaction on N-Queens N=8 (test)
27.2AccuracyHyperGuide
Evaluation results
| Method | Links | |
|---|---|---|
| HyperGuideBase model=Qwen2.52026.05 | 27.2 | |
| HyperGuideBase model=GPT-OSS2026.05 | 24.7 | |
| SoftCoTBase model=Qwen2.52026.05 | 22.2 | |
| SoftCoTBase model=GPT-OSS2026.05 | 18.5 | |
| HyperGuideBase model=Mistral2026.05 | 18.5 | |
| PT-SFTBase model=Mistral2026.05 | 16.1 | |
| Tree of ThoughtsBase model=GPT-OSS2026.05 | 13.6 | |
| Tree of ThoughtsBase model=Mistral2026.05 | 13.6 | |
| Self-ConsistencyBase model=Qwen2.52026.05 | 11.1 | |
| Few-shotBase model=Mistral2026.05 | 11.1 | |
| Self-ConsistencyBase model=Mistral2026.05 | 11.1 | |
| Few-shotBase model=Qwen2.52026.05 | 9.9 | |
| PT-SFTBase model=Qwen2.52026.05 | 9.9 | |
| PT-SFTBase model=GPT-OSS2026.05 | 9.9 | |
| SoftCoTBase model=Mistral2026.05 | 9.9 | |
| Few-shotBase model=GPT-OSS2026.05 | 6.1 | |
| OVMBase model=Qwen2.52026.05 | 4.9 | |
| Self-ConsistencyBase model=GPT-OSS2026.05 | 4.9 | |
| OVMBase model=GPT-OSS2026.05 | 4.9 | |
| Tree of ThoughtsBase model=Qwen2.52026.05 | 3.7 | |
| OVMBase model=Mistral2026.05 | 3.7 |