LTL Instruction Following on Letter Finite-horizon (full)
100Success Rate (SR)SEMLTL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SEMLTLTask Specification=FINITE-REACTIVE[5, 3], |Q|=56, |δ|=3382026.02 | 100 | 2.5 | |
| SEMLTLTask Specification=FINITE-REACTIVE[8, 2], |Q|=300, |δ|=2, 1152026.02 | 100 | 2.8 | |
| DEEPLTLTask Specification=LOCAL-SAFETY[3, 2], |Q|=39, |δ|=1722026.02 | 99 | — | |
| SEMLTLTask Specification=LOCAL-SAFETY[3, 2], |Q|=39, |δ|=1722026.02 | 99 | 4.92 | |
| SEMLTLTask Specification=LOCAL-SAFETY[3, 3], |Q|=233, |δ|=1, 3722026.02 | 99 | 5.38 | |
| SEMLTLTask Specification=LOCAL-SAFETY[3, 4], |Q|=753, |δ|=4, 9442026.02 | 99 | 5.62 | |
| DEEPLTLTask Specification=SMALL, |Q|=9, |δ|=232026.02 | 98 | — | |
| SEMLTLTask Specification=SMALL, |Q|=9, |δ|=232026.02 | 98 | 4.12 | |
| SEMLTLTask Specification=GLOBAL-SAFETY[3, 3], |Q|=27, |δ|=1162026.02 | 93 | 4.63 | |
| DEEPLTLTask Specification=GLOBAL-SAFETY[3, 3], |Q|=27, |δ|=1162026.02 | 92 | — | |
| SEMLTLTask Specification=GLOBAL-SAFETY[4, 6], |Q|=1, 072, |δ|=6, 4142026.02 | 91 | 6.77 | |
| LTL2ACTIONTask Specification=FINITE-REACTIVE[5, 3], |Q|=56, |δ|=3382026.02 | 86 | — | |
| LTL2ACTIONTask Specification=FINITE-REACTIVE[8, 2], |Q|=300, |δ|=2, 1152026.02 | 74 | — | |
| LTL2ACTIONTask Specification=SMALL, |Q|=9, |δ|=232026.02 | 67 | — | |
| LTL2ACTIONTask Specification=LOCAL-SAFETY[3, 2], |Q|=39, |δ|=1722026.02 | 59 | — | |
| LTL2ACTIONTask Specification=LOCAL-SAFETY[3, 3], |Q|=233, |δ|=1, 3722026.02 | 57 | — | |
| LTL2ACTIONTask Specification=LOCAL-SAFETY[3, 4], |Q|=753, |δ|=4, 9442026.02 | 42 | — | |
| LTL2ACTIONTask Specification=GLOBAL-SAFETY[3, 3], |Q|=27, |δ|=1162026.02 | 19 | — | |
| LTL2ACTIONTask Specification=GLOBAL-SAFETY[4, 6], |Q|=1, 072, |δ|=6, 4142026.02 | 12 | — |