Spatial Question Answering on OST-Bench 1,396 QA pairs benchmark leaderboard · SOTA2 Research

Spatial Question Answering on OST-Bench 1,396 QA pairs

65.04Average ScoreTRACE

Evaluation Results

Method	Links
TRACE2026.03		65.04	91.85	57.52	61.22	100	87.3	69.15	24.56	32.35	74.87	42.42	26.44	100	29.07	94.52	38.06
CM2026.03		64	88.59	54.9	57.14	100	88.89	69.15	21.05	33.92	78.89	36.36	27.53	100	11.85	97.26	38.89
LtM2026.03		63.75	88.04	44.44	63.27	100	88.89	77.11	21.05	35.88	76.88	40.91	22.33	100	7.78	100	36.94
Direct2026.03		62.65	92.39	51.63	53.06	100	85.71	63.68	21.05	34.12	76.38	40.91	28.77	100	9.26	91.78	40.28
ToT2026.03		62.2	91.3	52.29	51.02	100	90.48	64.68	15.79	29.22	75.38	40.91	27.53	100	15.74	84.93	41.39
CoT2026.03		61.69	89.67	48.37	48.98	100	82.54	68.66	15.79	33.33	75.38	39.39	28.77	97.14	11.3	89.04	39.31
TRACE2026.03		60.42	95.05	86.58	66.67	96.43	77.78	57	52.73	34.12	60.3	56.45	31.25	54.29	31.92	76.71	29.03
LtM2026.03		59.27	95.65	85.52	66.67	100	76.19	53	50.91	25.88	55.78	53.03	31.23	71.43	35.85	69.86	18.06
CoT2026.03		59.26	82.24	93.99	65.96	96.55	77.78	52.24	62.96	27.84	52.76	50	31.64	71.43	24.26	72.6	26.67
Direct2026.03		59.22	96.72	84.87	68.75	89.66	82.54	54.27	48.15	28.63	60.61	54.55	30	71.43	22.78	72.6	22.68
ToT2026.03		59.2	94.54	83.55	66.67	93.1	80.65	54.27	54.39	31	55.61	53.85	32.36	61.76	29.07	72.6	24.58
CM2026.03		59.04	95.05	86.18	68.75	89.66	77.78	55.72	48.15	25.4	60.3	49.23	26.3	80	24.81	69.86	28.47