inductive Prolog rule synthesis on SLR-Bench Hard tier 250 tasks 1
58.4AccuracyDF + CC + QO
Evaluation Results
| Method | Links | |
|---|---|---|
| DF + CC + QOCategory=Hybrid (symbolic + LLM fallback)2026.05 | 58.4 | |
| DF + CCCategory=Hybrid (symbolic + LLM fallback)2026.05 | 58 | |
| BoK + CCCategory=Hybrid (symbolic + LLM fallback)2026.05 | 52.8 | |
| BoK + CC + QOCategory=Hybrid (symbolic + LLM fallback)2026.05 | 52.8 | |
| DF + QOCategory=Hybrid (symbolic + LLM fallback)2026.05 | 49.6 | |
| CC SolverCategory=Symbolic solvers2026.05 | 46.8 | |
| gpt-5†Category=LLM-only methods2026.05 | 46 | |
| o3†Category=LLM-only methods2026.05 | 45 | |
| BoK + QOCategory=Hybrid (symbolic + LLM fallback)2026.05 | 40.8 | |
| QO SolverCategory=Symbolic solvers2026.05 | 37.2 | |
| DF-32Category=LLM-only methods2026.05 | 34.4 | |
| BoKCategory=LLM-only methods2026.05 | 17.2 | |
| Qwen3.6-35B-A3B (OpenHands)Category=LLM-only methods2026.05 | 14.8 |