Sequential Function Chart Generation on SFC Industrial Dataset
0.992Generation Successo3-mini
Evaluation results
| Method | Links | ||
|---|---|---|---|
| o3-miniModel Category=Proprietary Models, Configuration=Best2025.12 | 0.992 | 0.914 | |
| gpt-4.1Model Category=Proprietary Models, Configuration=Best2025.12 | 0.967 | 0.901 | |
| gemini-2.0-flashModel Category=Proprietary Models, Configuration=Best2025.12 | 0.949 | 0.921 | |
| gpt-4oModel Category=Proprietary Models, Configuration=Best2025.12 | 0.935 | 0.893 | |
| gpt-4.1-miniModel Category=Proprietary Models, Configuration=Best2025.12 | 0.934 | 0.911 | |
| gpt-4o-miniModel Category=Proprietary Models, Configuration=Best2025.12 | 0.861 | 0.899 | |
| Qwen2.5-Coder-14BModel Category=Open-Source Models, Configuration=Best2025.12 | 0.818 | 0.9183 | |
| Qwen3-14BModel Category=Open-Source Models, Configuration=Best2025.12 | 0.781 | 0.9192 | |
| Qwen3-32BModel Category=Open-Source Models, Configuration=Best2025.12 | 0.749 | 0.9201 | |
| Qwen2.5-Coder-32BModel Category=Open-Source Models, Configuration=Best2025.12 | 0.701 | 0.9208 | |
| phi-4Model Category=Open-Source Models, Configuration=Best2025.12 | 0.697 | 0.9203 | |
| Qwen3-4BModel Category=Open-Source Models, Configuration=Best2025.12 | 0.689 | 0.9195 | |
| Qwen2.5-Coder-7BModel Category=Open-Source Models, Configuration=Best2025.12 | 0.659 | 0.9207 |