List your company
ResearchFormerly WizWand

Navigation Visual Question Answering on NaVQA Short (S) horizon

76.2Descriptive AccuracyRAVEN
16.71232.15647.663.044Jun 23, 2026
Updated 4mo ago

Evaluation results

MethodLinks
RAVENLLM=Gemini-3-Pro, Encoder=Seed1.6-Embed2026.0676.24.580.2
RAVENLLM=Gemini-3-Pro, Encoder=QQMM-v2, Quantization=4-bit2026.0676.22.370.23
RAVENLLM=Gemini-2.5-Pro, Encoder=QQMM-v2, Quantization=4-bit2026.06693.790.29
RAVENLLM=Gemini-2.5-Pro, Encoder=SigLIP2026.0666.77.060.24
VLM OnlyLLM=Gemini-2.5-Pro2026.0666.73.90.11
ReMEmbRLLM=Gemini-2.5-Pro, Encoder=MixedBread2026.0666.76.110.16
VLM OnlyLLM=Gemini-3-Pro2026.0666.74.810.21
ReMEmbRLLM=Gemini-3-Pro, Encoder=MixedBread2026.0666.72.780.04
RAVENLLM=GPT-4o, Encoder=Seed1.6-Embed2026.0664.74.490.21
RAVENLLM=Gemini-2.5-Flash, Encoder=SigLIP2026.0663.47.390.24
VLM OnlyLLM=GPT-4o2026.0663.47.417.61
RAVENLLM=Gemini-2.5-Pro, Encoder=Seed1.6-Embed2026.0662.915.370.34
RAVENLLM=GPT-4o, Encoder=QQMM-v2, Quantization=4-bit2026.0662.53.990.19
RAVENLLM=Gemini-2.5-Pro, Encoder=CLIP-B2026.0661.912.350.24
ReMEmbRLLM=Gemini-2.5-Flash, Encoder=MixedBread2026.0659.59.10.2
VLM OnlyLLM=Gemini-2.5-Flash2026.0658.57.780.19
RAVENLLM=Gemini-2.5-Flash, Encoder=QQMM-v2, Quantization=4-bit2026.0651.24.490.21
RAVENLLM=Gemini-2.5-Flash, Encoder=CLIP-B2026.0651.29.840.21
RAVENLLM=Gemini-2.5-Flash, Encoder=Seed1.6-Embed2026.0641.725.310.33
ReMEmbRLLM=Gemini-2.5-Flash, Encoder=SigLIP2026.063117.450.59
ReMEmbRLLM=Gemini-2.5-Flash, Encoder=CLIP-B2026.0628.619.80.5
ReMEmbRLLM=Gemini-2.5-Flash, Encoder=Seed1.6-Embed2026.0626.221.290.25
ReMEmbRLLM=Gemini-2.5-Flash, Encoder=QQMM-v2, Quantization=4-bit2026.06199.460.43