Visual Question Answering (Perception) on CV-Bench, BLINK, and RealWorldQA
60.2CV-Bench ScoreLATTE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LATTELanguage / Vision=Qwen2-7B/SigLIP, Starting checkpoint=LLaVA-OV Stage 1.52024.12 | 60.2 | 52.6 | 61.1 | 58 | |
| LATTELanguage / Vision=LLaMA3-8B/CLIP, Starting checkpoint=Mantis Pretrained (Configuration 2)2024.12 | 57.2 | 47.8 | 53.7 | 52.9 | |
| LATTELanguage / Vision=LLaMA3-8B/CLIP, Starting checkpoint=Mantis Pretrained2024.12 | 56.9 | 49.6 | 51.1 | 52.6 | |
| Vanilla ITLanguage / Vision=Qwen2-7B/SigLIP, Starting checkpoint=LLaVA-OV Stage 1.52024.12 | 56.8 | 50.3 | 57.8 | 55 | |
| Vanilla ITLanguage / Vision=LLaMA3-8B/CLIP, Starting checkpoint=Mantis Pretrained2024.12 | 52.6 | 45.8 | 52.3 | 50.2 | |
| Vanilla ITLanguage / Vision=LLaMA3-8B/CLIP, Starting checkpoint=Mantis Pretrained (Configuration 2)2024.12 | 52.3 | 43.7 | 51.8 | 49.3 | |
| LATTELanguage / Vision=LLaMA3-8B/SigLIP, Starting checkpoint=Mantis Instruct-tuned2024.12 | 51.7 | 47.3 | 56.1 | 51.7 | |
| Vanilla ITLanguage / Vision=LLaMA3-8B/SigLIP, Starting checkpoint=Mantis Instruct-tuned2024.12 | 50.6 | 46.7 | 54.8 | 50.7 |