List your company
ResearchFormerly WizWand

Spatial VQA on SQA3D (test)

50.3Overall AccuracySPATIOROUTE-R
22.2229.5136.844.09May 18, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SPATIOROUTE-RModel=Qwen3-2B, Prompt Strategy=Rule-based dynamic routing2026.0550.3
SPATIOROUTE-LModel=Qwen3-2B, Prompt Strategy=LLM-driven prompt generation2026.0549.9
SPATIOROUTE-RModel=Qwen2-7B, Prompt Strategy=Rule-based dynamic routing2026.0549.5
SPATIOROUTE-LModel=Qwen2-7B, Prompt Strategy=LLM-driven prompt generation2026.0548.8
BaselineModel=Qwen3-2B, Prompt Strategy=Fixed minimal prompt2026.0548.3
CoTModel=Qwen3-2B, Prompt Strategy=Uniform step-by-step2026.0547.7
BaselineModel=Qwen3-4B (thinking), Prompt Strategy=Fixed minimal prompt2026.0547.7
BaselineModel=Qwen2-7B, Prompt Strategy=Fixed minimal prompt2026.0547.3
SPATIOROUTE-RModel=Qwen2.5-3B, Prompt Strategy=Rule-based dynamic routing2026.0547.1
SPATIOROUTE-RModel=Qwen2-2B, Prompt Strategy=Rule-based dynamic routing2026.0546.7
Prior workModel=Qwen2-7B2026.0546.5
SPATIOROUTE-LModel=Qwen2.5-3B, Prompt Strategy=LLM-driven prompt generation2026.0546.5
SPATIOROUTE-LModel=Qwen2-2B, Prompt Strategy=LLM-driven prompt generation2026.0545.7
BaselineModel=Qwen2.5-3B, Prompt Strategy=Fixed minimal prompt2026.0544.8
CoTModel=Qwen2-7B, Prompt Strategy=Uniform step-by-step2026.0542.1
BaselineModel=Qwen2-2B, Prompt Strategy=Fixed minimal prompt2026.0542
CoTModel=Qwen2-2B, Prompt Strategy=Uniform step-by-step2026.0538.9
CoTModel=Qwen2.5-3B, Prompt Strategy=Uniform step-by-step2026.0538.5
CoTModel=Llama3.2-11B, Prompt Strategy=Uniform step-by-step2026.0528.2
SPATIOROUTE-RModel=Llama3.2-11B, Prompt Strategy=Rule-based dynamic routing2026.0524.2
SPATIOROUTE-LModel=Llama3.2-11B, Prompt Strategy=LLM-driven prompt generation2026.0524
BaselineModel=Llama3.2-11B, Prompt Strategy=Fixed minimal prompt2026.0523.3