Instruction Following on R2R unseen (test)
62.2Success Rate (SR)SSM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SSMCCC=true2022.03 | 62.2 | 4.3 | 72.3 | 49.2 | |
| Active PerceptionCCC=true2022.03 | 60.6 | 4.3 | 71.4 | 41.3 | |
| SSMCCC=false2022.03 | 57.3 | 4.7 | 68.2 | 44.1 | |
| Active PerceptionCCC=false2022.03 | 55.7 | 4.8 | 73.1 | 37.1 | |
| AuxRN2022.03 | 55 | 5.2 | 62 | 51 | |
| Tactical Rewind2022.03 | 54 | 5.1 | 64 | 41 | |
| OAAM2022.03 | 53 | — | 61 | 50 | |
| E-DropoutCCC=true2022.03 | 52.2 | 5.1 | 59.8 | 46.9 | |
| Regretful2022.03 | 48 | 5.7 | 56 | 40 | |
| E-DropoutCCC=false2022.03 | 48 | 5.6 | 58 | 44 | |
| Self-Monitoring2022.03 | 43 | 6 | 55 | 32 |