Video Question Answering on MVBench 1.0 (test)

77AS ScoreVideoMind

Evaluation results

Method
VideoMind2025.03	77	78	77	46.5	70.5	87	71.5	33	48	39.5	91	53	78	89	43.5	53.5	61.5	37.5	49.5	53	61.9	—
VideoChat22025.03	75.5	58	83.5	50.5	60.5	87.5	74.5	45	47.5	44	82.5	37	64.5	87.5	51	66.5	47	35	37	72.5	60.4	—
VideoMind2025.03	74	71.5	81	50	77	93	75	38	48.5	46	91	39	80	94.5	49.5	55.5	70	40.5	57	61	64.6	—
PPLLAVA2024.11	73.5	61	83.5	45.5	68	87.5	75.5	33	37.5	40	83	37	67	96.5	50.5	43.5	59	35.5	44.5	63	59.2	—
PPLLAVA2024.11	69	54.4	69.5	50.5	69	87	67	38	35	33	69.5	37.5	63.5	91	47.5	47.5	51.5	27	47.5	57.5	57.1	—
VideoGPT+2025.03	69	60	83	48.5	66.5	85.5	75.5	36	44	34	89.5	39.5	71	90.5	45	53	50	29.5	44	60	58.7	—
PLLAVA2024.11	67.5	53	82	47	79	68.5	67.5	36.5	37.5	49.5	91	40.5	43	70	51.5	50	66.5	39.5	63.5	59	58.1	—
VideoChat22024.11	66	47.5	83.5	49.5	60	58	71.5	42.5	23	23	88.5	39	42	58.5	44	49	36.5	35	40.5	65.5	51.1	—
ST-LLM2024.11	66	53.5	84	44	58.5	80.5	73.5	38.5	42.5	31	86.5	36.5	56.5	78.5	43	44.5	46.5	34.5	41.5	58.5	54.9	—
PLLAVA2024.11	66	53	65.5	45	65	58	64.5	35.5	23.5	30	85	39.5	45.5	57	47.5	49.5	49	33	53	37	50.1	—
ST-LLM2025.03	66	53.5	84	44	58.5	80.5	73.5	38.5	42.5	31	86.5	36.5	56.5	78.5	43	44.5	46.5	34.5	41.5	58.5	54.9	—
PLLAVA2024.11	58	49	55.5	41	61	56	61	36	23.5	26	82	39.5	42	52	45	42	53.5	30.5	48	31	46.6	—
PLLaVA2025.03	58	49	55.5	41	61	56	61	36	23.5	26	82	39.5	42	52	45	42	53.5	30.5	48	31	46.6	—
GPT-4V2024.11	55.5	63.5	72	46.5	73.5	18.5	59	29.5	12	40.5	83.5	39	12	22.5	45	47.5	52	31	59	11	43.5	—
GPT-4V2025.03	55.5	63.5	72	46.5	73.5	18.5	59	29.5	12	40.5	83.5	39	12	22.5	45	47.5	52	31	59	11	43.5	—
ShareGPT4Video2025.03	49.5	39.5	79.5	40	54.5	82.5	54.5	32.5	50.5	41.5	84.5	35.5	62.5	75	51	25.5	46.5	28.5	39	51.5	51.2	—
Video-LLaVA2025.03	46	42.5	56.5	39	53.5	53	48	41	29	31.5	82.5	45	26	53	41.5	33.5	41.5	27.5	38.5	31.5	43	—
TimeChat2025.03	40.5	36	61	32.5	53	53.5	41.5	29	19.5	26.5	66.5	34	20	43.5	42	36.5	36	29	35	35	38.5	—
VideoChat2024.11	33.5	26.5	56	33.5	40.5	53	40.5	30	25.5	27	48.5	35	20.5	42.5	22.5	48.5	29	33	29.5	26	35.5	—
VideoChat2025.03	33.5	26.5	56	33.5	40.5	53	40.5	30	25.5	27	48.5	35	20.5	42.5	46	26.5	41	23.5	23.5	36	35.5	—
Video-LLaMA2024.11	27.5	25.5	51	29	39	48	40.5	38	22.5	22.5	43	34	22.5	32.5	45.5	32.5	40	30	21	37	34.1	—
Video-LLaMA2025.03	27.5	25.5	51	29	39	48	40.5	38	22.5	22.5	43	34	22.5	32.5	45.5	32.5	40	30	21	37	34.1	—
Video-ChatGPT2024.11	23.5	26	62	22.5	26.5	54	28	40	23	20	31	30.5	25.5	39.5	46	26.5	41	23.5	23.5	36	33.5	—
Video-ChatGPT2025.03	23.5	26	62	22.5	26.5	54	28	40	23	20	31	30.5	25.5	39.5	48.5	29	33	29.5	26	35.5	32.7	—
LLaMA-Adapter2024.11	23	28	51	30	33	53.5	32.5	33.5	25.5	21.5	30.5	29	22.5	41.5	39.5	25	31.5	22.5	28	32	31.7	—
MUSEG-7B2025.05	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	67.4
Qwen2.5-VL-7B-Instruct2025.05	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	—	65.7