Video Question Answering on StoryVideoQA-G 1.0 (gold)

89.12Precision (C)PlotTree

Evaluation results

Method
PlotTree2026.06	89.12	88.32	88.28	89.22	87.45	85.89	89.31	94.86	87.23	89.35	86.88	88.61	91.75	85.39	88.8
Video2RAG*2026.06	85.84	86.02	86.03	86.77	86.33	83.79	81.85	90.78	83.77	86.39	84.16	88.35	90.75	87.08	86.24
Gemini-3-Flash2026.06	85.32	84.21	84.14	88.09	85.77	83.37	87.7	93.79	88.53	88.95	88.91	93.16	92.75	90.73	87.96
PlotTree2026.06	83.07	75.66	78.28	82.8	85.58	81.89	87.3	91.67	92.64	92.11	90.5	91.9	93.25	93.26	86.5
VideoTree2026.06	81.87	83.72	79.31	89.22	81.84	84.84	90.52	93.62	88.31	90.14	87.56	88.86	93	89.33	86.98
Video2RAG*2026.06	77.72	71.05	73.45	80.34	79.59	78.11	85.89	90.78	91.99	91.12	89.37	90.13	90.5	91.57	83.63
GPT-5.22026.06	73.23	73.85	80.17	84.88	78.28	82.11	89.11	92.91	90.04	93.29	90.72	91.39	92.75	92.98	85.38
Long-VITA2026.06	63.39	71.38	66.21	73.91	67.42	77.26	82.46	73.76	75.32	70.41	76.92	76.2	80.25	83.71	73.52
VideoLLaMA32026.06	60.45	72.04	68.62	79.02	72.66	82.53	86.29	86.88	85.28	88.56	86.43	89.11	88.25	88.76	80.09
VideoChat-Flash2026.06	60.45	71.88	68.79	76.37	76.4	80	85.89	87.77	83.77	89.74	84.62	90.89	88.5	88.2	80.01
ViLAMP2026.06	58.55	69.08	64.83	74.29	72.28	77.47	77.62	87.41	85.28	85.8	82.35	87.59	87.5	86.52	77.34
Qwen3-VL2026.06	58.03	68.91	62.59	76.56	68.16	77.89	83.06	86.52	87.01	87.38	88.69	91.14	89.5	91.01	78.48
VideoTree2026.06	56.3	53.78	56.55	65.78	61.24	66.74	73.19	86.17	81.6	86.39	82.13	86.08	85.75	85.96	72.02
Video-XL2026.06	51.3	61.84	60.17	66.16	60.86	69.05	70.77	73.76	72.29	77.71	73.76	80.51	75	78.93	68.5
VideoLLaMA22026.06	48.36	52.47	58.45	62.76	63.48	68.63	77.62	79.08	79.22	83.63	79.41	83.04	82.25	82.58	70.13
MA-LMM2026.06	46.98	49.18	54.31	53.88	58.8	65.89	67.54	75.89	70.78	74.75	73.3	78.23	76.25	77.53	64.69
VideoChat22026.06	38	44.74	51.9	48.96	54.12	61.05	72.78	67.2	63.2	70.22	64.03	68.35	70.5	69.94	59.23
Chat-UniVi2026.06	31.78	40.79	25.34	41.4	25.66	38.95	31.85	30.32	35.06	19.33	28.05	21.27	31.25	23.88	30.71
SeViLA2026.06	27.12	22.7	32.07	20.98	32.4	28.63	20.97	22.7	18.61	23.67	17.19	19.49	21.25	17.42	23.66
TimeChat2026.06	24.35	21.05	37.76	28.36	41.01	33.05	31.25	44.68	43.51	52.27	42.08	47.34	43	43.82	37.36
SINGULARITY2026.06	22.63	20.07	18.45	21.36	18.73	21.89	19.76	21.63	21	20.91	25.11	18.73	17	17.7	20.44
VIOLETv22026.06	18.83	14.97	18.28	16.64	19.48	18.53	16.33	12.77	12.12	15.19	11.09	13.16	18.5	12.92	15.78
Vid-TLDR2026.06	18.83	20.23	22.07	20.04	26.59	23.79	25.6	22.34	20.56	24.46	18.33	24.3	25.5	22.19	22.39
Video-ChatGPT2026.06	9.33	18.26	5.34	19.66	8.8	14.32	14.31	28.55	29.87	26.63	26.92	23.29	28	19.66	18.95