List your company

Generalized Planning on 17 PDDL Domains

98Average CoverageSymbolic ff 30m
36.6452.5768.584.43Aug 19, 2025

Evaluation results

MethodLinks
Symbolic ff 30mMethod=Symbolic Planner (ff), Time Limit=30m2025.0898—10010010010010010059100100100100100100100100100100
DeepSeek (F5-3) BestFoundation Model=DeepSeek, Framework=F5-3, Evaluation Protocol=Coverage best run2025.0893—100100100100100100100431001001001007860100100100
DeepSeek (F3-6)Foundation Model=DeepSeek, Framework=F3-6, Evaluation Protocol=Avg coverage three runs2025.0882—10010010010086831003010085100886460456782
Qwen3 Thinking (F3-6) BestFoundation Model=Qwen3 Thinking, Framework=F3-6, Evaluation Protocol=Coverage best run2025.0882—100100641001001001001010065100100654844100100
DeepSeek (F5-3)Foundation Model=DeepSeek, Framework=F5-3, Evaluation Protocol=Avg coverage three runs2025.0879—67100100100100100100241006780887235636782
DeepSeek (Bas)Foundation Model=DeepSeek, Framework=Bas, Evaluation Protocol=Avg coverage three runs2025.0868—1001008810086711002427310088622052081
Qwen3 Thinking (F3-6-MC)Foundation Model=Qwen3 Thinking, Framework=F3-6, Ablation=-MC, Evaluation Protocol=Avg coverage three runs2025.0865—1001006410033891002853498673415446774
Qwen3 Thinking (F3-6)Foundation Model=Qwen3 Thinking, Framework=F3-6, Evaluation Protocol=Avg coverage three runs2025.0864—7010064100334110077837100855320439165
Qwen3 Thinking (F5-3)Foundation Model=Qwen3 Thinking, Framework=F5-3, Evaluation Protocol=Avg coverage three runs2025.0860—10010043100444110004228100945513473377
Qwen3 Thinking (F3-6-SD)Foundation Model=Qwen3 Thinking, Framework=F3-6, Ablation=-SD, Evaluation Protocol=Avg coverage three runs2025.0859—1001007610001110035927100946111444170
DeepSeek (Sil)Foundation Model=DeepSeek, Framework=Sil, Evaluation Protocol=Avg coverage three runs2025.0856—10010067673341330676691077161510083
Qwen3 Thinking (F3-6-CR)Foundation Model=Qwen3 Thinking, Framework=F3-6, Ablation=-CR, Evaluation Protocol=Avg coverage three runs2025.0854—1001006010033910004489194375443352
Symbolic lm 45sMethod=Symbolic Planner (lm), Time Limit=45s2025.0853—0311510010056150798922389988761582
Qwen3 Thinking (Bas)Foundation Model=Qwen3 Thinking, Framework=Bas, Evaluation Protocol=Avg coverage three runs2025.0844—100100641002721670713981518335030
Qwen3 Thinking (Sil)Foundation Model=Qwen3 Thinking, Framework=Sil, Evaluation Protocol=Avg coverage three runs2025.0839—7067431007646151341984140333332