Multimodal Reasoning and Tool-use on MM-Vet
44.7MM-Vet Tool-use ScorePPLLAVA
Evaluation Results
| Method | Links | |
|---|---|---|
| PPLLAVAResolution=336*3362024.11 | 44.7 | |
| LLaVA-Next-VideoResolution=336*3362024.11 | 44 | |
| LLaVA-Next-7BResolution=672*6722024.11 | 43.9 | |
| LLaVA-1.5 + MMInstructLLM=Vicuna-13B2024.07 | 37.9 | |
| LLaVA-1.5-13BResolution=336*3362024.11 | 36.3 | |
| LLaVA-1.5LLM=Vicuna-13B2024.07 | 35.4 | |
| LLaVA-1.5 + MMInstructLLM=Vicuna-7B2024.07 | 34.4 | |
| VideoLLaVAResolution=336*3362024.11 | 32 | |
| LLaVA-1.5LLM=Vicuna-7B2024.07 | 30.5 | |
| Chat-Univ-1.5Resolution=336*3362024.11 | 28.3 | |
| InstructBLIPLLM=Vicuna-7B2024.07 | 26.2 | |
| InstructBLIPLLM=Vicuna-13B2024.07 | 25.6 | |
| BLIP-2LLM=Vicuna-13B2024.07 | 22.4 |