Vision-and-Dialog Navigation on CVDN (test)
976Goal ProgressSHORTEST PATH AGENT
Evaluation results
| Method | Links | |
|---|---|---|
| SHORTEST PATH AGENTSupervision Setting=Mixed2020.02 | 976 | |
| Shortest Path AgentType=Baseline (upper bound)2020.03 | 976 | |
| SHORTEST PATH AGENTSupervision Setting=Navigator2020.02 | 848 | |
| SHORTEST PATH AGENTSupervision Setting=Oracle2020.02 | 806 | |
| MT-RCM + EnvAgType=Leaderboard Submission2020.03 | 391 | |
| PREVALENTSupervision Setting=Mixed2020.02 | 244 | |
| PREVALENTSupervision Setting=Navigator2020.02 | 239 | |
| SEQ2SEQSupervision Setting=Mixed2020.02 | 235 | |
| Seq2SeqType=Leaderboard Submission2020.03 | 235 | |
| SEQ2SEQSupervision Setting=Navigator2020.02 | 211 | |
| PREVALENTSupervision Setting=Oracle2020.02 | 167 | |
| SEQ2SEQSupervision Setting=Oracle2020.02 | 125 | |
| RANDOMSupervision Setting=Oracle2020.02 | 83 | |
| RANDOMSupervision Setting=Navigator2020.02 | 83 | |
| RANDOMSupervision Setting=Mixed2020.02 | 83 | |
| RandomType=Baseline2020.03 | 83 | |
| HAMTvariant=encoder-decoder2021.10 | 5.58 | |
| MT-RCM+EnvAg2021.10 | 3.91 | |
| VISITRON2021.10 | 3.11 | |
| PREVALENT2021.10 | 2.44 |