List your company
ResearchFormerly WizWand

Navigation on REVERIE (val unseen)

62.4Success Rate (SR)TANDEM
1.87217.58633.349.014Aug 20, 2021Jun 7, 2022Mar 25, 2023Jan 10, 2024Oct 27, 2024Aug 14, 2025Jun 2, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TANDEM2026.0662.4—45.6—
Previous SOTA2024.0961———
ScaleVLN2026.0657—41.8—
AutoVLN2026.0655.9—40.9—
GOAT2026.0653.4—36.7—
DUET2026.0647—33.7—
SAME2026.0646.4—36.1—
NaviLLM2026.0642.2—35.7—
HAMT2026.0633—30.2—
HAMT2021.1032.9536.8430.214.08
Fine-TuningUpdated Params(%)=1002023.0832.6337.8228.9215.66
VLN-PETLUpdated Params(%)=2.812023.0831.8137.0327.6714.47
HOPversion=22022.0331.7836.2426.1116.46
GPT-4o2024.0931.6———
SIA2021.1031.5344.6716.2841.53
Qwen2-VL-72BModel Parameters=72B2024.0931———
RecBERT2022.0330.6735.0224.916.78
RecBERT2021.1030.6735.0224.916.78
HOPversion=12022.0330.3935.325.117.16
AdapterUpdated Params(%)=3.392023.0829.4832.8326.6214.59
LORAUpdated Params(%)=3.332023.0829.4234.2826.1715.96
AirBERT2022.0327.8934.5121.8818.71
Rec (Airbert)mode=discriminative2021.0827.8934.5121.8818.71
Rec (OSCAR)mode=discriminative2021.0825.5327.6621.0614.35
Rec (VLN-BERT)mode=discriminative2021.0825.5329.4220.5116.94
BitFitUpdated Params(%)=0.802023.0824.6527.4621.3412.36
Rec (ViLBERT)mode=discriminative2021.0824.5729.9119.8117.83
HOPversion=02022.0324.1730.1620.0716.52
Prompt TuningUpdated Params(%)=0.712023.0819.9425.0817.7512.43
ORIST2022.0316.8425.0215.1410.9
FAST-MATTN2022.0314.428.27.1945.28
FAST-MATTN2021.1014.428.27.1945.28
FAST-MATTN2021.0814.428.27.1945.28
FAST-Short2022.0310.0820.486.1729.7
RCM2022.039.2914.236.9711.98
RCM2021.109.2914.236.9711.98
RCM2021.089.2914.236.9711.98
SMNA2022.038.1511.286.449.07
SMNA2021.108.1511.286.449.07
SMNA2021.088.1511.286.449.07
Seq2Seq2021.104.28.072.8411.07
Seq2Seq-SF2021.084.28.072.8411.07