Human-Aware Vision-and-Language Navigation on HA-VLN Unseen 1.0 (val)
0.67Navigation Error (NE)Oracle
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| OracleEvaluation Protocol=Ground-truth Baseline2024.06 | 0.67 | 0.008 | 0.037 | 0.89 | |
| AirbertEvaluation Protocol=Difference from Oracle2024.06 | 4.57 | 0.23 | 0.7 | -0.49 | |
| Rec(Prevalent)Evaluation Protocol=Difference from Oracle2024.06 | 5.19 | 0.23 | 0.66 | -0.53 | |
| Rec(OSCAR)Evaluation Protocol=Difference from Oracle2024.06 | 5.19 | 0.22 | 0.65 | -0.51 | |
| Speaker-FollowerEvaluation Protocol=Difference from Oracle2024.06 | 6.49 | 0.24 | 0.59 | -0.66 |