LTL Instruction Following on ZoneEnv Finite-horizon
97Success Rate (SR)DEEPLTL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DEEPLTLTask Formula=((green ∨ red) → (¬orange U purple)) U orange, |Q| (number of LDBA states)=8, |δ| (number of transitions)=202026.02 | 97 | — | |
| SEMLTLTask Formula=((green ∨ red) → (¬orange U purple)) U orange, |Q| (number of LDBA states)=8, |δ| (number of transitions)=202026.02 | 96 | 4 | |
| DEEPLTLTask Formula=F(pink ∨ green) ∧ F brown ∧ F purple, |Q| (number of LDBA states)=4, |δ| (number of transitions)=82026.02 | 96 | — | |
| SEMLTLTask Formula=F(blue ∧ (¬orange U gray)) ∧ F purple, |Q| (number of LDBA states)=5, |δ| (number of transitions)=122026.02 | 95 | 3.1 | |
| DEEPLTLTask Formula=F(blue ∧ (¬orange U gray)) ∧ F purple, |Q| (number of LDBA states)=5, |δ| (number of transitions)=122026.02 | 94 | — | |
| DEEPLTLTask Formula=(F red) ∧ (¬red U (green ∧ F orange)), |Q| (number of LDBA states)=5, |δ| (number of transitions)=102026.02 | 93 | — | |
| SEMLTLTask Formula=(F red) ∧ (¬red U (green ∧ F orange)), |Q| (number of LDBA states)=5, |δ| (number of transitions)=102026.02 | 93 | 3.19 | |
| DEEPLTLTask Formula=¬gray U ((red ∨ purple) ∧ (¬orange U brown)), |Q| (number of LDBA states)=6, |δ| (number of transitions)=122026.02 | 91 | — | |
| SEMLTLTask Formula=¬gray U ((red ∨ purple) ∧ (¬orange U brown)), |Q| (number of LDBA states)=6, |δ| (number of transitions)=122026.02 | 91 | 4 | |
| SEMLTLTask Formula=F(pink ∨ green) ∧ F brown ∧ F purple, |Q| (number of LDBA states)=4, |δ| (number of transitions)=82026.02 | 90 | 2.11 | |
| DEEPLTLTask Formula=¬(purple ∨ orange) U (red ∧ F gray), |Q| (number of LDBA states)=6, |δ| (number of transitions)=152026.02 | 85 | — | |
| SEMLTLTask Formula=¬(purple ∨ orange) U (red ∧ F gray), |Q| (number of LDBA states)=6, |δ| (number of transitions)=152026.02 | 85 | 4.01 | |
| LTL2ACTIONTask Formula=((green ∨ red) → (¬orange U purple)) U orange, |Q| (number of LDBA states)=8, |δ| (number of transitions)=202026.02 | 85 | — | |
| LTL2ACTIONTask Formula=F(pink ∨ green) ∧ F brown ∧ F purple, |Q| (number of LDBA states)=4, |δ| (number of transitions)=82026.02 | 61 | — | |
| LTL2ACTIONTask Formula=¬gray U ((red ∨ purple) ∧ (¬orange U brown)), |Q| (number of LDBA states)=6, |δ| (number of transitions)=122026.02 | 56 | — | |
| LTL2ACTIONTask Formula=F(blue ∧ (¬orange U gray)) ∧ F purple, |Q| (number of LDBA states)=5, |δ| (number of transitions)=122026.02 | 53 | — | |
| LTL2ACTIONTask Formula=¬(purple ∨ orange) U (red ∧ F gray), |Q| (number of LDBA states)=6, |δ| (number of transitions)=152026.02 | 38 | — | |
| LTL2ACTIONTask Formula=(F red) ∧ (¬red U (green ∧ F orange)), |Q| (number of LDBA states)=5, |δ| (number of transitions)=102026.02 | 15 | — |