Multimodal Model Evaluation on MME (Full Suite)
75Existence ScoreMiniGPT-4
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| MiniGPT-4Number of training samples=3439 samples2023.08 | 75 | 30 | 36.67 | 38.33 | 35.71 | 62.06 | 52.75 | 22.25 | 23.5 | 57.5 | 433.77 | 46.43 | 47.5 | 50 | 47.5 | 191.43 | 625.2 | |
| MM-LIMANumber of training samples=200 samples2023.08 | 73.33 | 31.67 | 38.33 | 36.67 | 36.05 | 59.71 | 57.75 | 29.25 | 50.5 | 50 | 463.26 | 40 | 50 | 47.5 | 47.5 | 185 | 648.26 | |
| Random SelectionNumber of training samples=200 samples2023.08 | 56.67 | 23.89 | 33.33 | 30 | 32.99 | 50.69 | 46 | 18.92 | 16.91 | 55 | 364.4 | 34.52 | 45 | 44.17 | 40.17 | 162.85 | 527.26 |