LMM Evaluation on M-Vista
25.3AccuracyInstructBLIP-13B
Evaluation results
| Method | Links | |
|---|---|---|
| InstructBLIP-13BI/R Pairs=1.2M, Train Res.=224, Eval Res.=2242023.11 | 25.3 | |
| OtterHD-8BI/R Pairs=370K, Train Res.=Dynamic, Eval Res.=Original2023.11 | 23.5 | |
| OtterHD-8BI/R Pairs=370K, Train Res.=512, Eval Res.=5122023.11 | 22.3 | |
| Fuyu-8BEval Res.=Original2023.11 | 20.6 | |
| Idefics-9BinstructI/R Pairs=1M, Train Res.=224, Eval Res.=2242023.11 | 19.8 | |
| Otter-9BI/R Pairs=150K, Train Res.=224, Eval Res.=2242023.11 | 19.7 | |
| OtterHD-8BI/R Pairs=370K, Train Res.=1024, Eval Res.=10242023.11 | 17.3 |