# Visual Question Answering on MMVP-VLM Source: [Visual Question Answering on MMVP-VLM]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:54:20.405Z Evaluation of model performance on the MMVP-VLM dataset for visual question answering capabilities, reporting detailed sub-category scores and an overall average. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Visual Question Answering | | Dataset (including any stated split) | MMVP-VLM | | Metric | Orientation & Direction Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 10 of 10 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Orientation & Direction Score](): Higher is better; unit: PERCENT. - [Feature Presence Score](): Higher is better; unit: PERCENT. - [State & Condition Score](): Higher is better; unit: PERCENT. - [Quantity & Count Score](): Higher is better; unit: PERCENT. - [Positional Context Score](): Higher is better; unit: PERCENT. - [Color & Appearance Score](): Higher is better; unit: PERCENT. - [Structural Characteristics Score](): Higher is better; unit: PERCENT. - [Text Comprehension Score](): Higher is better; unit: PERCENT. - [Viewpoint & Perspective Score](): Higher is better; unit: PERCENT. - [MMVP Average Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Orientation & Direction Score | Result date | Report paper | | --- | --- | --- | --- | | SigLIP ViT-SO-14 | 26.7 | Not recorded | 68fa72f81e209131cea59a64 | | SigLIP VIT-SO-14 | 20 | Not recorded | 68fa72f81e209131cea59a64 | | DFN VIT-H-14 | 20 | Not recorded | 68fa72f81e209131cea59a64 | | EVA01 ViT-g-14 | 16.7 | Not recorded | 68fa72f81e209131cea59a64 | | OpenAI ViT-L-14 | 13.3 | Not recorded | 68fa72f81e209131cea59a64 | | DFN VIT-H-14 | 13.3 | Not recorded | 68fa72f81e209131cea59a64 | | MetaCLIP VIT-L-14 | 13.3 | Not recorded | 68fa72f81e209131cea59a64 | | EVA02 ViT-bigE-14+ | 13.3 | Not recorded | 68fa72f81e209131cea59a64 | | MetaCLIP VIT-H-14 | 6.7 | Not recorded | 68fa72f81e209131cea59a64 | | OpenAI ViT-L-14 | 0 | Not recorded | 68fa72f81e209131cea59a64 | ### SigLIP ViT-SO-14 Orientation & Direction Score: 26.7. Result ID: 6992a6033a6c314849106343. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Image Size":"224^2","Params (M)":877.4,"zero-shot":true}. This record does not assert independent reproduction. ### SigLIP VIT-SO-14 Orientation & Direction Score: 20. Result ID: 6992a6033a6c314849106344. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Image Size":"384^2","Params (M)":878,"zero-shot":true}. This record does not assert independent reproduction. ### DFN VIT-H-14 Orientation & Direction Score: 20. Result ID: 6992a6033a6c314849106345. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Image Size":"224^2","Params (M)":986.1,"zero-shot":true}. This record does not assert independent reproduction. ### EVA01 ViT-g-14 Orientation & Direction Score: 16.7. Result ID: 6992a6033a6c314849106349. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Image Size":"224^2","Params (M)":1136.4,"zero-shot":true}. This record does not assert independent reproduction. ### OpenAI ViT-L-14 Orientation & Direction Score: 13.3. Result ID: 6992a6033a6c314849106341. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Image Size":"224^2","Params (M)":427.6,"zero-shot":true}. This record does not assert independent reproduction. ### DFN VIT-H-14 Orientation & Direction Score: 13.3. Result ID: 6992a6033a6c314849106346. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Image Size":"378^2","Params (M)":986.7,"zero-shot":true}. This record does not assert independent reproduction. ### MetaCLIP VIT-L-14 Orientation & Direction Score: 13.3. Result ID: 6992a6033a6c314849106347. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Image Size":"224^2","Params (M)":427.6,"zero-shot":true}. This record does not assert independent reproduction. ### EVA02 ViT-bigE-14+ Orientation & Direction Score: 13.3. Result ID: 6992a6033a6c31484910634a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Image Size":"224^2","Params (M)":5044.9,"zero-shot":true}. This record does not assert independent reproduction. ### MetaCLIP VIT-H-14 Orientation & Direction Score: 6.7. Result ID: 6992a6033a6c314849106348. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Image Size":"224^2","Params (M)":986.1,"zero-shot":true}. This record does not assert independent reproduction. ### OpenAI ViT-L-14 Orientation & Direction Score: 0. Result ID: 6992a6033a6c314849106342. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Image Size":"336^2","Params (M)":427.9,"zero-shot":true}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.