Hallucination Diagnosis on VideoHallucer benchmark leaderboard · SOTA2 Research

Hallucination Diagnosis on VideoHallucer

95.5Object-Relation Basic AccuracyVideoChatGPT

Evaluation Results

Method	Links
VideoChatGPT2024.11		95.5	7	6	100	0	0	96.5	4	2	86.5	21	17	98	13.5	7	6.4
VideoLLAVA2024.11		95	38	34.5	97.5	13.5	13.5	97	14	12	93	4.5	3	93	31.5	26	17.8
VideoLaVIT2024.11		94.5	39	35.5	88.5	27	25.5	96.5	13	10.5	97.5	6	4	97.5	21.5	19	18.9
Video-LLaMA22024.11		88.5	21.5	18	91.5	8.5	7.5	99	1.5	1	88	8.5	6.5	87.5	23.5	17	10
DynFocus2024.11		88	62	52.5	87	37.5	29	96.5	33.5	31.5	91.5	42	38.5	98.5	15	13	35.1
LLAMA-VID2024.11		87.5	55.5	44.5	78.5	35	27	90.5	30	25.5	85	17.5	12.5	84.5	46.5	36.5	23.5
DynFocus2024.11		86.5	56	48	86	21.5	18.5	92	34	27	96.5	9	6	97.5	42	38.5	28.3
MiniGPT4-Video2024.11		80.5	34.5	27.5	68.5	27	18	68.5	27	23.5	86	16.5	12	83.5	37.5	30.5	22.3
LLAMA-VID2024.11		78.5	59	43.5	86	55.5	24	89	24	18	78.5	35	27	85.5	27.5	17	21
PLLAVA2024.11		76	76.5	60	46.5	58	23.5	83	71.5	57	85	18	9.5	85	53.5	40.5	38.1
LLaVA-NeXT2024.11		72	73	51.5	53	61	28	63.5	69	38	62.5	41	14	61.5	60.5	28.5	32
VideoChat22024.11		26	41.5	10.5	23.5	25	7.5	33	26	9	32	16.5	7	34	20	5	7.8