Program Synthesis on PSB 1
100Compare String LengthHOTGP
Evaluation results
| Method | Links | |||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| HOTGPSplit=Test2025.11 | 100 | — | 46 | — | 0 | 0 | 39 | 32 | 0 | 73 | 1 | 100 | 100 | 38 | — | 59 | 95 | 87 | 1 | — | 0 | 79 | 34 | — | 3 | 6 | 8 | — | 15 | — | 4 | |
| HOTGPSplit=Test, Simplification=after simplification procedure2025.11 | 100 | — | 50 | — | 0 | 0 | 59 | 37 | 0 | 99 | 1 | 100 | 100 | 38 | — | 59 | 100 | 89 | 1 | — | 0 | 80 | 37 | — | 4 | 7 | 10 | — | 15 | — | 9 | |
| DSLSSplit=Test2025.11 | 51 | 18 | 11 | 28 | 50 | 2 | 5 | 2 | 65 | 69 | 99 | 82 | 99 | 100 | 31 | 22 | 98 | 95 | 25 | 4 | 64 | 97 | 21 | 91 | 1 | 8 | 13 | — | 24 | 0 | 11 | |
| UMADSplit=Test2025.11 | 42 | 5 | 12 | 11 | 20 | 0 | 1 | 0 | 56 | 48 | 100 | 82 | 100 | 87 | 20 | 4 | 100 | 86 | 26 | 0 | 48 | 92 | 9 | 59 | 3 | 7 | 9 | — | 21 | 0 | 4 | |
| CBGPSplit=Test2025.11 | 22 | — | 0 | 0 | — | — | 0 | — | 10 | 98 | 100 | 99 | 100 | 0 | — | 0 | 100 | — | — | — | — | 88 | 100 | — | 4 | 7 | 7 | — | 9 | — | 4 | |
| PushGPSplit=Test2025.11 | 7 | 0 | 8 | 7 | 6 | 2 | 1 | 4 | 21 | 45 | 78 | 45 | 98 | 51 | 2 | 5 | 81 | 66 | 6 | 0 | 18 | 16 | 1 | 8 | 0 | 3 | 5 | — | 22 | 0 | 1 | |
| G3PhsSplit=Test2025.11 | 5 | — | — | — | — | — | — | — | 0 | 96 | — | 0 | 99 | — | — | 4 | 100 | 0 | — | 5 | — | 4 | 68 | — | 1 | 3 | 4 | — | 8 | — | 1 | |
| G3PSplit=Test2025.11 | 2 | 0 | 12 | 0 | 0 | 1 | 8 | 31 | 22 | 79 | 0 | 63 | 94 | 0 | 2 | 7 | 94 | 68 | 3 | 21 | 0 | 5 | 91 | 0 | 0 | 4 | 6 | — | 17 | 0 | 0 | |
| Origamivariant=AC/DC2025.11 | 0.97 | 0.7 | 1 | 0 | 0.63 | 0.38 | 0.97 | 1 | 0.93 | 1 | 1 | 1 | 1 | 0.2 | 1 | 0.67 | 1 | 1 | 0.3 | 0.63 | 0.8 | 1 | 0.87 | 0 | 0.1 | 0.15 | 0.2 | 0.21 | 0.22 | — | — | |
| PushGPvariant=DSLS2025.11 | 0.51 | 0.18 | 0.11 | 0.28 | 0.5 | 0.02 | 0.05 | 0.02 | 0.65 | 0.69 | 0.99 | 0.82 | 0.99 | 1 | 0.31 | 0.22 | 0.98 | 0.95 | 0.25 | 0.04 | 0.64 | 0.97 | 0.21 | 0.91 | 0.01 | 0.08 | 0.13 | 0.16 | 0.24 | — | — | |
| PushGPvariant=UMAD2025.11 | 0.42 | 0.05 | 0.12 | 0.11 | 0.2 | 0 | 0.01 | 0 | 0.56 | 0.48 | 1 | 0.82 | 1 | 0.87 | 0.2 | 0.04 | 1 | 0.86 | 0.26 | 0 | 0.48 | 0.92 | 0.09 | 0.59 | 0.03 | 0.07 | 0.09 | 0.13 | 0.21 | — | — | |
| CBGP2025.11 | 0.22 | — | 0 | 0 | — | — | 0 | — | 0.1 | 0.98 | 1 | 0.99 | 1 | 0 | — | 0 | 1 | — | — | — | — | 0.88 | 1 | — | 0.04 | 0.07 | 0.07 | 0.07 | 0.09 | — | — | |
| PushGPvariant=02025.11 | 0.07 | 0 | 0.08 | 0.07 | 0.06 | 0.02 | 0.01 | 0.04 | 0.21 | 0.45 | 0.78 | 0.45 | 0.98 | 0.51 | 0.02 | 0.05 | 0.81 | 0.66 | 0.06 | 0 | 0.18 | 0.16 | 0.01 | 0.08 | 0 | 0.03 | 0.05 | 0.07 | 0.22 | — | — | |
| G3P+Split=Test2025.11 | 0 | 0 | 3 | 0 | 0 | 0 | 6 | 31 | 44 | 59 | 25 | 13 | 83 | 16 | 1 | 9 | 73 | 18 | 5 | 0 | 39 | 0 | 21 | 0 | 0 | 1 | 3 | — | 17 | 3 | 1 | |
| G3PpySplit=Test2025.11 | 0 | — | — | — | — | — | — | — | 2 | 21 | — | 66 | 100 | — | — | 0 | 89 | 34 | — | 38 | — | 0 | 0 | — | 1 | 2 | 3 | — | 7 | — | 2 |