Adversarial Generation on WOMD
65.57Attack Success RateRule
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| RuleAgainst Policy=RL Policy2026.05 | 65.57 | 2.761 | — | 113.7 | 1.803 | 6.148 | 10.85 | 13.47 | 0.336 | |
| Rule2025.09 | 60.54 | 2.763 | 4.833 | 36.947 | 1.973 | 6.856 | 4.466 | 8.447 | 0.309 | |
| CAT2025.09 | 43.48 | 1.746 | 10.275 | 3.207 | 3.345 | 8.696 | 1.595 | 7.55 | 0.231 | |
| KG-ASGAgainst Policy=RL Policy2026.05 | 39 | 1.87 | — | 3.002 | 0.02 | 0 | 2.217 | 0.838 | 0.202 | |
| SEAL2025.09 | 33.7 | 0.942 | 5.785 | 2.719 | 3.562 | 11.233 | 1.695 | 7.368 | 0.276 | |
| SAGEw_adv=1.02025.09 | 33.51 | 1.779 | 1.433 | 2.48 | 0.79 | 1.09 | 2.098 | 8.07 | 0.185 | |
| SEALAgainst Policy=RL Policy2026.05 | 31.4 | 0.752 | — | 2.684 | 3.03 | 11.98 | 1.563 | 8.267 | 0.267 | |
| CATAgainst Policy=RL Policy2026.05 | 30.33 | 1.319 | — | 3.039 | 2.623 | 6.967 | 1.539 | 8.877 | 0.187 | |
| SAGEAgainst Policy=RL Policy2026.05 | 28.42 | 1.4 | — | 2.496 | 0.792 | 1.366 | 2.098 | 8.114 | 0.188 | |
| SAGEw_adv=0.52025.09 | 20.98 | 1.183 | 0.498 | 2.068 | 0.817 | 0.954 | 1.522 | 8.458 | 0.08 | |
| AdvTrajOpt2025.09 | 20.44 | 0.963 | 4.528 | 2.797 | 2.561 | 10.354 | 1.75 | 6.173 | 0.27 | |
| AdvTrajOptAgainst Policy=RL Policy2026.05 | 19.4 | 0.992 | — | 2.779 | 2.459 | 9.973 | 1.749 | 6.187 | 0.269 | |
| KINGAgainst Policy=RL Policy2026.05 | 19.14 | 1.148 | — | 2.596 | 3.114 | 5.857 | 0.983 | 259.1 | 0.097 | |
| KING2025.09 | 16.48 | 1.146 | 2.451 | 2.566 | 3.097 | 5.824 | 0.955 | 257.619 | 0.097 | |
| GOOSE2025.09 | 16.39 | 0.439 | 5.092 | 11.25 | 3.722 | 12.64 | 3.716 | 8.223 | 0.157 | |
| SAGEw_adv=0.02025.09 | 13.9 | 0.864 | 0.332 | 2 | 0.708 | 0.954 | 1.461 | 9.318 | 0.055 | |
| GOOSEAgainst Policy=RL Policy2026.05 | 12.46 | 0.667 | — | 15.47 | 3.507 | 11.45 | 4.662 | 8.07 | 0.152 |