Multi-modal Understanding on MM-Vet
46.9RecLLaVA1.5-BPO
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LLaVA1.5-BPOParameters=13B2024.03 | 46.9 | 31.6 | 34.6 | 37.2 | 36.1 | 11.5 | 41.4 | |
| LLaVA1.5-BPOParameters=7B2024.03 | 41.3 | 29.5 | 24.8 | 27.8 | 34.8 | 11.5 | 36.8 | |
| LLaVA1.5Parameters=13B2024.03 | 41.1 | 29.1 | 23 | 24.2 | 35.6 | 7.7 | 36.8 | |
| LLaVA1.5Parameters=7B2024.03 | 37 | 22.9 | 16.8 | 20.2 | 25.7 | 7.7 | 31.7 | |
| LLaVAParameters=13B2024.03 | 30.9 | 20.1 | 23.5 | 26.4 | 24.3 | 7.7 | 26.4 | |
| InstructBLIPParameters=14B2024.03 | 30.8 | 16 | 9.8 | 9 | 21.1 | 10.5 | 25.6 | |
| MiniGPT-4Parameters=14B2024.03 | 29.9 | 16.1 | 20.4 | 22.1 | 22.2 | 3.8 | 24.4 | |
| LLaVAParameters=7B2024.03 | 28 | 17.1 | 16.3 | 18.9 | 21.2 | 11.5 | 23.8 | |
| BLIP-2Parameters=12B2024.03 | 27.5 | 11.1 | 11.8 | 7 | 16.2 | 5.8 | 22.4 | |
| MiniGPT-4Parameters=8B2024.03 | 27.4 | 15 | 12.8 | 13.9 | 20.3 | 7.7 | 22.1 | |
| OtterParameters=9B2024.03 | 27.3 | 17.8 | 14.2 | 13.8 | 24.4 | 3.8 | 24.7 | |
| FarSightBase Model=MiniGPT-42026.03 | 26.3 | 12.3 | 14.5 | 14.6 | 14.7 | 3.5 | 20.3 | |
| AIRBase Model=MiniGPT-42026.03 | 25.1 | 15.1 | 15.5 | 11.2 | 23.7 | 7.7 | 22 | |
| AD-HHBase Model=MiniGPT-42026.03 | 23.7 | 12.4 | 11.9 | 12.6 | 14.8 | 3.5 | 18.9 | |
| GreedyBase Model=MiniGPT-42026.03 | 22.3 | 14.7 | 13.6 | 10 | 21.7 | 7.7 | 20 | |
| OPERABase Model=MiniGPT-42026.03 | 20.9 | 15.1 | 10.5 | 10.5 | 19.5 | 12.7 | 18.5 | |
| DoLABase Model=MiniGPT-42026.03 | 20.7 | 14.4 | 13.6 | 10 | 21.7 | 7.3 | 18.8 | |
| HALCBase Model=MiniGPT-42026.03 | 19.4 | 11.9 | 11.3 | 8.6 | 16.5 | 6.5 | 16.6 | |
| VCDBase Model=MiniGPT-42026.03 | 17.1 | 10 | 7.9 | 7.8 | 11.7 | 7.3 | 14.2 |