SFC Generation on PLCopen XML Industrial Dataset
99.25Pass@10 Geno3-mini
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| o3-miniDecoding Strategy=Structured, Prompting Strategy=zero-shot2025.12 | 99.25 | 99.25 | 99.16 | |
| gpt-4oDecoding Strategy=Structured, Prompting Strategy=3-shot2025.12 | 96.74 | 96.74 | 94.77 | |
| gemini-2.0-flashDecoding Strategy=Structured, Prompting Strategy=3-shot2025.12 | 94.96 | 94.92 | 85.59 | |
| gpt-4oDecoding Strategy=Structured, Prompting Strategy=zero-shot2025.12 | 93.84 | 93.84 | 92 | |
| gpt-4o-miniDecoding Strategy=Structured, Prompting Strategy=3-shot2025.12 | 93.43 | 93.43 | 86.48 | |
| gpt-4o-miniDecoding Strategy=Unstructured, Prompting Strategy=3-shot2025.12 | 86.15 | 86.1 | 85.5 |