Remote Embodied Visual Referencing on REVERIE 1.0 (val seen)
61.91Succ.Scene-Intuitive Agent
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Scene-Intuitive Agent2021.03 | 61.91 | 65.85 | 57.08 | 13.61 | 45.96 | 42.65 | |
| HOPversion=12022.03 | 54.81 | 56.08 | 48.05 | 14.05 | — | — | |
| HOPversion=22022.03 | 53.76 | 54.88 | 47.19 | 13.8 | — | — | |
| RecBERT2022.03 | 51.79 | 53.9 | 47.96 | 13.44 | — | — | |
| REVERIE2021.03 | 50.53 | 55.17 | 45.5 | 16.35 | 31.97 | 29.66 | |
| FAST-MATTN2022.03 | 50.53 | 55.17 | 45.5 | 16.35 | — | — | |
| AirBERT2022.03 | 47.01 | 48.98 | 42.34 | 15.16 | — | — | |
| ORIST2022.03 | 45.19 | 49.12 | 42.21 | 10.73 | — | — | |
| FAST-short + MattNet2021.03 | 45.12 | 49.68 | 40.18 | 13.22 | 31.41 | 28.11 | |
| FAST-Short2022.03 | 45.12 | 49.68 | 40.18 | 13.22 | — | — | |
| HOPversion=02022.03 | 43.78 | 46.03 | 40.11 | 11.67 | — | — | |
| SelfMonitor + MattNet2021.03 | 41.25 | 43.29 | 39.61 | 7.54 | 30.07 | 28.98 | |
| SMNA2022.03 | 41.25 | 43.29 | 39.61 | 7.54 | — | — | |
| RCM + MattNet2021.03 | 23.33 | 29.44 | 21.82 | 10.7 | 16.23 | 15.36 | |
| RCM2022.03 | 23.33 | 29.44 | 21.82 | 10.7 | — | — | |
| AirBERT2022.03 | — | — | — | — | 32.75 | 30.01 | |
| FAST-MATTN2022.03 | — | — | — | — | 31.97 | 29.66 | |
| FAST-Short2022.03 | — | — | — | — | 31.41 | 28.11 | |
| HOPversion=02022.03 | — | — | — | — | 28.95 | 26.69 | |
| HOPversion=12022.03 | — | — | — | — | 40.55 | 38.79 | |
| HOPversion=22022.03 | — | — | — | — | 38.65 | 33.85 | |
| ORIST2022.03 | — | — | — | — | 29.87 | 27.77 | |
| RCM2022.03 | — | — | — | — | 16.23 | 15.36 | |
| RecBERT2022.03 | — | — | — | — | 38.23 | 35.61 | |
| SMNA2022.03 | — | — | — | — | 30.07 | 28.98 |