List your company

Makespan Accuracy on AsyncPlan-XXL

98Accuracy (S5)GPT-5-mini
-3.9222.544975.46May 31, 2026

Evaluation results

MethodLinks
GPT-5-miniFormalization Method=Planner2026.059810098946638104200043
DeepSeek-V4-FlashFormalization Method=Planner2026.05989694686000000030
Qwen3.6 35B A3BFormalization Method=Planner2026.05988498100908874786644322273
Gemini-3-flashFormalization Method=CP-SAT Formalizer2026.0598100100100100989810096100969698
GPT-5-miniFormalization Method=CP-SAT Formalizer2026.059810010010010098981009698888697
DeepSeek-V4-FlashFormalization Method=CP-SAT Formalizer2026.05981001001001009898100961009610099
Qwen3.6 35B A3BFormalization Method=CP-SAT Formalizer2026.05981001001001009898100961009610099
Qwen3.6 35B A3BApproach=Planner2026.05988498100908468766238262070
Gemini-3-flashApproach=CP-SAT Formalizer2026.059810010010010096981009296969498
GPT-5-miniApproach=CP-SAT Formalizer2026.05981001001001009698968276454186
GPT-5-miniApproach=Planner2026.05961009494603484200041
DeepSeek-V4-FlashApproach=Planner2026.05969694686000000030
Gemini-3-flashFormalization Method=Planner2026.059454221841222400018
Gemini-3-flashApproach=Planner2026.059452221841200400017
DeepSeek-V4-FlashApproach=CP-SAT Formalizer2026.05941001001001009698989498949697
Qwen3.6 35B A3BApproach=CP-SAT Formalizer2026.0584989498989296100941009610096
DeepSeek-V4-FlashFormalization Method=PDDL2.1 Formalizer2026.0582806656545864484842424257
Gemini-3-flashFormalization Method=PDDL2.1 Formalizer2026.0576968692827664542646222671
GPT-5-miniFormalization Method=PDDL2.1 Formalizer2026.0541665640363252382022101035
Qwen3.6 35B A3BFormalization Method=PDDL2.1 Formalizer2026.0541444240382821010108023
GPT-5-miniApproach=PDDL2.1 Formalizer2026.053848403218202410400020
Gemini-3-flashApproach=PDDL2.1 Formalizer2026.0514000000000001
DeepSeek-V4-FlashApproach=PDDL2.1 Formalizer2026.050000000000000
Qwen3.6 35B A3BApproach=PDDL2.1 Formalizer2026.050000000000000