Vision-Language Navigation on R2R-Goal (val unseen)
36Success Rate (SR)Human Annotation
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Human AnnotationInstruction Generator=Human Annotation, Evaluation Navigator Agent=ETPNav2025.08 | 36 | 28 | |
| Human AnnotationInstruction Generator=Human Annotation, Evaluation Navigator Agent=BEVBert2025.08 | 34 | 27 | |
| Anole-7B + InterleavedInstruction Generator=Anole-7B + Interleaved, Evaluation Navigator Agent=ETPNav2025.08 | 34 | 25 | |
| Anole-7B + InterleavedInstruction Generator=Anole-7B + Interleaved, Evaluation Navigator Agent=BEVBert2025.08 | 33 | 25 | |
| Anole-7B + One-passInstruction Generator=Anole-7B + One-pass, Evaluation Navigator Agent=ETPNav2025.08 | 31 | 20 | |
| C-InstructorInstruction Generator=C-Instructor, Evaluation Navigator Agent=ETPNav2025.08 | 29 | 19 | |
| Anole-7B + One-passInstruction Generator=Anole-7B + One-pass, Evaluation Navigator Agent=BEVBert2025.08 | 29 | 21 | |
| C-InstructorInstruction Generator=C-Instructor, Evaluation Navigator Agent=BEVBert2025.08 | 27 | 18 | |
| Gemini 3.0Instruction Generator=Gemini 3.0, Evaluation Navigator Agent=ETPNav2025.08 | 27 | 18 | |
| Claude 4 OpusInstruction Generator=Claude 4 Opus, Evaluation Navigator Agent=ETPNav2025.08 | 26 | 16 | |
| GPT-4o + CoTInstruction Generator=GPT-4o + CoT, Evaluation Navigator Agent=ETPNav2025.08 | 25 | 17 | |
| Gemini 3.0Instruction Generator=Gemini 3.0, Evaluation Navigator Agent=BEVBert2025.08 | 25 | 14 | |
| Claude 4 OpusInstruction Generator=Claude 4 Opus, Evaluation Navigator Agent=BEVBert2025.08 | 25 | 17 | |
| Anole-7B + CoTInstruction Generator=Anole-7B + CoT, Evaluation Navigator Agent=ETPNav2025.08 | 25 | 16 | |
| GPT-4o + CoTInstruction Generator=GPT-4o + CoT, Evaluation Navigator Agent=BEVBert2025.08 | 24 | 17 | |
| GPT-4oInstruction Generator=GPT-4o, Evaluation Navigator Agent=ETPNav2025.08 | 23 | 16 | |
| Anole-7B + CoTInstruction Generator=Anole-7B + CoT, Evaluation Navigator Agent=BEVBert2025.08 | 23 | 15 | |
| GPT-4oInstruction Generator=GPT-4o, Evaluation Navigator Agent=BEVBert2025.08 | 22 | 14 | |
| Anole-7B + DirectInstruction Generator=Anole-7B + Direct, Evaluation Navigator Agent=ETPNav2025.08 | 20 | 14 | |
| LANAInstruction Generator=LANA, Evaluation Navigator Agent=ETPNav2025.08 | 18 | 11 | |
| Anole-7B + DirectInstruction Generator=Anole-7B + Direct, Evaluation Navigator Agent=BEVBert2025.08 | 18 | 13 | |
| LANAInstruction Generator=LANA, Evaluation Navigator Agent=BEVBert2025.08 | 17 | 12 |