Constraint satisfaction on ZL-XXL
97.7Accuracy (%)Gemini 2.5 Pro+ASP
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini 2.5 Pro+ASPInference Pipeline=LLM+ASP, Prompt Reference Type=Compact Reference2026.04 | 97.7 | |
| o4-mini+ASPInference Pipeline=LLM+ASP, Prompt Reference Type=Compact Reference2026.04 | 76.7 | |
| DS-R1-0528+ASPInference Pipeline=LLM+ASP, Prompt Reference Type=Compact Reference2026.04 | 75 | |
| Gemini 2.5 Flash+ASPInference Pipeline=LLM+ASP, Prompt Reference Type=Compact Reference2026.04 | 70.3 | |
| DS-V3+ASPInference Pipeline=LLM+ASP, Prompt Reference Type=Compact Reference2026.04 | 37 | |
| o4-miniInference Pipeline=Baseline2026.04 | 34 | |
| Gemini 2.5 ProInference Pipeline=Baseline2026.04 | 32.3 | |
| DS-R1-0528Inference Pipeline=Baseline2026.04 | 27.7 | |
| Gemini 2.5 FlashInference Pipeline=Baseline2026.04 | 20 | |
| DS-V3Inference Pipeline=Baseline2026.04 | 7 |