Vision-Language Evaluation on MME (test) benchmark leaderboard · SOTA2 Research

Vision-Language Evaluation on MME (test)

136.43Communication ScoreBLIVA

Evaluation Results

Method	Links
BLIVA2023.09		136.43	57.5	77.5	60	180	138.33	81.67	180	87.5	155.1	140.88	151.5	89.5	133.25	119.23
MMICL2023.09		136.43	82.5	132.5	77.5	170	160	81.67	156.67	100	146.26	141.76	153.75	136.13	135.5	129.33
InstructBLIP2023.09		129.29	40	65	57.5	185	143.33	66.67	153.33	72.5	123.81	101.18	153	79.75	134.25	107.47
Lynx2023.09		110.71	17.5	42.5	45	195	151.67	90	170	77.5	124.83	118.24	164.5	162	119.5	113.5
BLIP-22023.09		110	40	65	75	160	135	73.33	148.33	110	141.84	105.59	145.25	138	136.5	113.13
Otter2023.09		106.43	72.5	57.5	70	195	88.33	86.67	113.33	72.5	138.78	172.65	158.75	137.25	129	114.19
LRV-Instruction2023.09		100.71	70	85	72.5	165	111.67	86.67	165	110	139.04	112.65	147.98	160.53	101.25	116.29
GIT22023.09		99.29	50	67.5	45	190	118.33	96.67	158.33	65	112.59	145.88	158.5	140.5	146.25	113.85
Cheetor2023.09		98.57	77.5	57.5	87.5	180	96.67	80	116.67	100	147.28	164.12	156	145.73	113.5	115.79
LaVIN2023.09		87.14	65	47.5	50	185	88.33	63.33	75	107.5	79.59	47.35	136.75	93.5	87.25	86.66
LLaMA-Adapter-V22023.09		81.43	62.5	50	55	120	50	48.33	75	125	99.66	86.18	148.5	150.25	69.75	87.26
mPLUG-Owl2023.09		78.57	60	80	57.5	120	50	50	55	65	136.05	100.29	135.5	159.25	96.25	88.82
VPGTrans2023.09		64.29	50	77.5	57.5	70	85	63.33	73.33	77.5	84.01	53.53	141.75	64.75	77.25	74.27
MiniGPT-42023.09		59.29	45	0	40	68.33	55	43.33	75	57.5	41.84	54.41	71.75	54	60.5	51.85
LLaVA2023.09		57.14	50	57.5	50	50	50	50	55	50	50	48.82	50	50	49	51.25
MultiModal-GPT2023.09		49.29	62.5	60	55	61.67	55	58.33	68.33	82.5	57.82	73.82	68	69.75	59.5	62.97
VisualGLM-6B2023.09		39.29	45	50	47.5	85	50	48.33	55	42.5	65.99	53.24	146.25	83.75	75.25	63.36