Multi-modal Understanding on CV-Bench, BLINK, RealWorldQA, MathVista, MMStar, MMVet Suite
53.8Average ScoreLATTE
Evaluation results
| Method | Links | |
|---|---|---|
| LATTELanguage / Vision=Qwen2-7B/SigLIP, Starting checkpoint=LLaVA-OV Stage 1.52024.12 | 53.8 | |
| Vanilla ITLanguage / Vision=Qwen2-7B/SigLIP, Starting checkpoint=LLaVA-OV Stage 1.52024.12 | 49.5 | |
| LATTELanguage / Vision=LLaMA3-8B/SigLIP, Starting checkpoint=Mantis Instruct-tuned2024.12 | 48.2 | |
| LATTELanguage / Vision=LLaMA3-8B/CLIP, Starting checkpoint=Mantis Pretrained (Configuration 2)2024.12 | 47.2 | |
| LATTELanguage / Vision=LLaMA3-8B/CLIP, Starting checkpoint=Mantis Pretrained2024.12 | 46.7 | |
| Vanilla ITLanguage / Vision=LLaMA3-8B/SigLIP, Starting checkpoint=Mantis Instruct-tuned2024.12 | 43.1 | |
| Vanilla ITLanguage / Vision=LLaMA3-8B/CLIP, Starting checkpoint=Mantis Pretrained (Configuration 2)2024.12 | 42.1 | |
| Vanilla ITLanguage / Vision=LLaMA3-8B/CLIP, Starting checkpoint=Mantis Pretrained2024.12 | 41.6 |