# VQA

Source: [VQA](<https://www.sota2.com/research/task/vqa>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.



## Benchmarks

Page 1 of 2. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/task/vqa.md?page=2>): Follow this link to discover more pages.

- [General VQA on MMVet](<https://www.sota2.com/research/sota/general-vqa-on-mmvet.md>): General VQA; MMVet.

- [Multi-Modal Visual Question Answering on RAD-ChestCT (val)](<https://www.sota2.com/research/sota/multi-modal-visual-question-answering-on-rad-chestct-val.md>): Multi-Modal Visual Question Answering (MMVQA); RAD-ChestCT (val).

- [Multi-Modal Visual Question Answering on CT-RATE (val)](<https://www.sota2.com/research/sota/multi-modal-visual-question-answering-on-ct-rate-val.md>): Multi-Modal Visual Question Answering (MMVQA); CT-RATE (val).

- [Open-ended VQA on MMOral-OPG](<https://www.sota2.com/research/sota/open-ended-vqa-on-mmoral-opg.md>): Open-ended VQA; MMOral-OPG.

- [General VQA on MMStar](<https://www.sota2.com/research/sota/general-vqa-on-mmstar.md>): General VQA; MMStar.

- [Visual Question Answering on MLLMU-Bench 5% (forget)](<https://www.sota2.com/research/sota/visual-question-answering-on-mllmu-bench-5-percent-forget.md>): Visual Question Answering (VQA); MLLMU-Bench 5% (forget).

- [VQA on VQA hard criterion](<https://www.sota2.com/research/sota/vqa-on-vqa-hard-criterion.md>): VQA; VQA hard criterion.

- [VQA Hallucination Detection on POPE Average (Random, Popular, Adversarial) 2023](<https://www.sota2.com/research/sota/vqa-hallucination-detection-on-pope-average-random-popular-adversarial-2023.md>): VQA Hallucination Detection; POPE Average of Random, Popular, and Adversarial 2023.

- [MVQA on Personalization Benchmark](<https://www.sota2.com/research/sota/mvqa-on-personalization-benchmark.md>): MVQA; Personalization Benchmark.

- [Spatial VQA on SQA3D (test)](<https://www.sota2.com/research/sota/spatial-vqa-on-sqa3d-test.md>): Spatial VQA; SQA3D (test).

- [OCR VQA on ChartQA (test)](<https://www.sota2.com/research/sota/ocr-vqa-on-chartqa-test.md>): OCR VQA; ChartQA (test).

- [Open-ended Generative VQA on IRIS-120K Generative Overall](<https://www.sota2.com/research/sota/open-ended-generative-vqa-on-iris-120k-generative-overall.md>): Open-ended Generative VQA; IRIS-120K Generative Overall.

- [Open-ended Generative VQA on IRIS-120K Scene-VQA](<https://www.sota2.com/research/sota/open-ended-generative-vqa-on-iris-120k-scene-vqa.md>): Open-ended Generative VQA; IRIS-120K Scene-VQA.

- [Open-ended Generative VQA on IRIS-120K Tree-VQA](<https://www.sota2.com/research/sota/open-ended-generative-vqa-on-iris-120k-tree-vqa.md>): Open-ended Generative VQA; IRIS-120K Tree-VQA.

- [Visual Question Answering on MLLMU-Bench 5% forget (Real)](<https://www.sota2.com/research/sota/visual-question-answering-on-mllmu-bench-5-percent-forget-real.md>): Visual Question Answering (VQA); MLLMU-Bench 5% forget (Real).

- [Visual Question Answering on MLLMU-Bench 5% forget (test)](<https://www.sota2.com/research/sota/visual-question-answering-on-mllmu-bench-5-percent-forget-test.md>): Visual Question Answering (VQA); MLLMU-Bench 5% forget (test).

- [VQA Hallucination on MMHal](<https://www.sota2.com/research/sota/vqa-hallucination-on-mmhal.md>): VQA Hallucination; MMHal.

- [Open-ended VQA on MMOral-X](<https://www.sota2.com/research/sota/open-ended-vqa-on-mmoral-x.md>): Open-ended VQA; MMOral-X.

- [Radiology VQA on IU-Xray](<https://www.sota2.com/research/sota/radiology-vqa-on-iu-xray.md>): Radiology VQA; IU-Xray.

- [General VQA on HallusionBench](<https://www.sota2.com/research/sota/general-vqa-on-hallusionbench.md>): General VQA; HallusionBench.

- [General VQA on MME](<https://www.sota2.com/research/sota/general-vqa-on-mme.md>): General VQA; MME.

- [Fine-grained VQA on V\*](<https://www.sota2.com/research/sota/fine-grained-vqa-on-v.md>): Fine-grained VQA; V\*.

- [Visual Question Answering (VQA) on MLLMU-Bench 5% forget](<https://www.sota2.com/research/sota/visual-question-answering-vqa-on-mllmu-bench-5-percent-forget.md>): Visual Question Answering (VQA); MLLMU-Bench 5% forget.

- [VQA (Specific) on VQA (Specific)](<https://www.sota2.com/research/sota/vqa-specific-on-vqa-specific.md>): VQA (Specific); VQA (Specific).

- [VQA (General) on Vision-Language Tasks General VQA](<https://www.sota2.com/research/sota/vqa-general-on-vision-language-tasks-general-vqa.md>): VQA (General); Vision-Language Tasks General VQA.

- [Knowledge-based VQA on InfoSeek](<https://www.sota2.com/research/sota/knowledge-based-vqa-on-infoseek.md>): Knowledge-based VQA; InfoSeek.

- [General VQA on RWQA pt-PT](<https://www.sota2.com/research/sota/general-vqa-on-rwqa-pt-pt.md>): General VQA; RWQA pt-PT.

- [General VQA on POPE pt-PT](<https://www.sota2.com/research/sota/general-vqa-on-pope-pt-pt.md>): General VQA; POPE pt-PT.

- [General VQA on SEED pt-PT](<https://www.sota2.com/research/sota/general-vqa-on-seed-pt-pt.md>): General VQA; SEED pt-PT.

- [General VQA on MMPro pt-PT](<https://www.sota2.com/research/sota/general-vqa-on-mmpro-pt-pt.md>): General VQA; MMPro pt-PT.

- [General VQA on MMStar pt-PT](<https://www.sota2.com/research/sota/general-vqa-on-mmstar-pt-pt.md>): General VQA; MMStar pt-PT.

- [General VQA on MMMU pt-PT](<https://www.sota2.com/research/sota/general-vqa-on-mmmu-pt-pt.md>): General VQA; MMMU pt-PT.

- [General VQA on MME pt-PT](<https://www.sota2.com/research/sota/general-vqa-on-mme-pt-pt.md>): General VQA; MME pt-PT.

- [Medical VQA on In-house (Held-out)](<https://www.sota2.com/research/sota/medical-vqa-on-in-house-held-out.md>): Medical VQA; In-house (Held-out).

- [Medical VQA on BiomedParse In-Domain (test)](<https://www.sota2.com/research/sota/medical-vqa-on-biomedparse-in-domain-test.md>): Medical VQA; BiomedParse In-Domain (test).

- [Medical VQA on MSD In-Domain (test)](<https://www.sota2.com/research/sota/medical-vqa-on-msd-in-domain-test.md>): Medical VQA; MSD In-Domain (test).

- [Knowledge-based VQA on E-VQA](<https://www.sota2.com/research/sota/knowledge-based-vqa-on-e-vqa.md>): Knowledge-based VQA; E-VQA.

- [Robotic Failure Analysis VQA on ViFailback-Bench](<https://www.sota2.com/research/sota/robotic-failure-analysis-vqa-on-vifailback-bench.md>): Robotic Failure Analysis VQA; ViFailback-Bench.

- [Robotic Failure Analysis VQA on ViFailback-Bench Hard](<https://www.sota2.com/research/sota/robotic-failure-analysis-vqa-on-vifailback-bench-hard.md>): Robotic Failure Analysis VQA; ViFailback-Bench Hard.

- [Robotic Failure Analysis VQA on ViFailback-Bench Lite](<https://www.sota2.com/research/sota/robotic-failure-analysis-vqa-on-vifailback-bench-lite.md>): Robotic Failure Analysis VQA; ViFailback-Bench Lite.

- [OCR VQA on InfoVQA (val)](<https://www.sota2.com/research/sota/ocr-vqa-on-infovqa-val.md>): OCR VQA; InfoVQA (val).

- [General VQA on MMMU (val)](<https://www.sota2.com/research/sota/general-vqa-on-mmmu-val.md>): General VQA; MMMU (val).

- [General VQA on MMBench en (dev)](<https://www.sota2.com/research/sota/general-vqa-on-mmbench-en-dev.md>): General VQA; MMBench en (dev).

- [VQA on RexTime 1.0 (test)](<https://www.sota2.com/research/sota/vqa-on-rextime-1-0-test.md>): VQA; RexTime 1.0 (test).

- [Spatial VQA on 3DSRBench Level 1-3](<https://www.sota2.com/research/sota/spatial-vqa-on-3dsrbench-level-1-3.md>): Spatial VQA; 3DSRBench Level 1-3.

- [Spatial VQA on CV-Bench-2D Relation (Level 2)](<https://www.sota2.com/research/sota/spatial-vqa-on-cv-bench-2d-relation-level-2.md>): Spatial VQA; CV-Bench-2D Relation (Level 2).

- [Spatial VQA on CV-Bench-3D Level 2](<https://www.sota2.com/research/sota/spatial-vqa-on-cv-bench-3d-level-2.md>): Spatial VQA; CV-Bench-3D Level 2.

- [Spatial VQA on RoboSpatial](<https://www.sota2.com/research/sota/spatial-vqa-on-robospatial.md>): Spatial VQA; RoboSpatial.

- [Spatial VQA on EmbSpatial](<https://www.sota2.com/research/sota/spatial-vqa-on-embspatial.md>): Spatial VQA; EmbSpatial.

- [General VQA on POPE](<https://www.sota2.com/research/sota/general-vqa-on-pope.md>): General VQA; POPE.

- [General VQA on HRBench](<https://www.sota2.com/research/sota/general-vqa-on-hrbench.md>): General VQA; HRBench.

- [General VQA on GUIChat](<https://www.sota2.com/research/sota/general-vqa-on-guichat.md>): General VQA; GUIChat.

- [OCR-VQA Average on DOCVQA, INFOVQA, CHARTQA, and TEXTVQA](<https://www.sota2.com/research/sota/ocr-vqa-average-on-docvqa-infovqa-chartqa-and-textvqa.md>): OCR-VQA; DOCVQA, INFOVQA, CHARTQA, and TEXTVQA Average.

- [OCR-VQA on TEXTVQA](<https://www.sota2.com/research/sota/ocr-vqa-on-textvqa.md>): OCR-VQA; TEXTVQA.

- [OCR-VQA on CHARTQA](<https://www.sota2.com/research/sota/ocr-vqa-on-chartqa.md>): OCR-VQA; CHARTQA.

- [OCR-VQA on INFOVQA](<https://www.sota2.com/research/sota/ocr-vqa-on-infovqa.md>): OCR-VQA; INFOVQA.

- [OCR-VQA on DOCVQA](<https://www.sota2.com/research/sota/ocr-vqa-on-docvqa.md>): OCR-VQA; DOCVQA.

- [Grounded VQA on SurgVidLM Out-of-domain (test)](<https://www.sota2.com/research/sota/grounded-vqa-on-surgvidlm-out-of-domain-test.md>): Grounded VQA; SurgVidLM Out-of-domain (test).

- [Grounded VQA on MedVideoCap In-domain (test)](<https://www.sota2.com/research/sota/grounded-vqa-on-medvideocap-in-domain-test.md>): Grounded VQA; MedVideoCap In-domain (test).

- [Grounded VQA on OphVL In-domain (test)](<https://www.sota2.com/research/sota/grounded-vqa-on-ophvl-in-domain-test.md>): Grounded VQA; OphVL In-domain (test).

- [MM General VQA on Q-Bench (val)](<https://www.sota2.com/research/sota/mm-general-vqa-on-q-bench-val.md>): MM General VQA; Q-Bench (val).

- [MM General VQA on A-Bench (val)](<https://www.sota2.com/research/sota/mm-general-vqa-on-a-bench-val.md>): MM General VQA; A-Bench (val).

- [MM General VQA on ScienceQA (test)](<https://www.sota2.com/research/sota/mm-general-vqa-on-scienceqa-test.md>): MM General VQA; ScienceQA (test).

- [MM General VQA on SEEDBench IMG](<https://www.sota2.com/research/sota/mm-general-vqa-on-seedbench-img.md>): MM General VQA; SEEDBench IMG.

- [OVQA on Personalization Benchmark](<https://www.sota2.com/research/sota/ovqa-on-personalization-benchmark.md>): OVQA; Personalization Benchmark.

- [Multimodal VQA on MMLongBench-Doc 2K Packed](<https://www.sota2.com/research/sota/multimodal-vqa-on-mmlongbench-doc-2k-packed.md>): Multimodal VQA; MMLongBench-Doc 2K Packed.

- [VQA on Falcon-X (test)](<https://www.sota2.com/research/sota/vqa-on-falcon-x-test.md>): VQA; Falcon-X (test).

- [Open-ended VQA on Personalization Evaluation Benchmark](<https://www.sota2.com/research/sota/open-ended-vqa-on-personalization-evaluation-benchmark.md>): Open-ended VQA; Personalization Evaluation Benchmark.

- [Driving VQA on DriveLM (test)](<https://www.sota2.com/research/sota/driving-vqa-on-drivelm-test.md>): Driving VQA; DriveLM (test).

- [VQA Hallucination on POPE MS COCO v1 (test)](<https://www.sota2.com/research/sota/vqa-hallucination-on-pope-ms-coco-v1-test.md>): VQA Hallucination; POPE MS COCO v1 (test).

- [Multiple-choice VQA on CBIS](<https://www.sota2.com/research/sota/multiple-choice-vqa-on-cbis.md>): Multiple-choice VQA; CBIS.

- [Multiple-choice VQA on WBCAtt](<https://www.sota2.com/research/sota/multiple-choice-vqa-on-wbcatt.md>): Multiple-choice VQA; WBCAtt.

- [Multiple-choice VQA on SKINCON](<https://www.sota2.com/research/sota/multiple-choice-vqa-on-skincon.md>): Multiple-choice VQA; SKINCON.

- [Temporal VQA on Next-QA ATP](<https://www.sota2.com/research/sota/temporal-vqa-on-next-qa-atp.md>): Temporal VQA; Next-QA ATP.

- [OCR VQA on TextVQA (test)](<https://www.sota2.com/research/sota/ocr-vqa-on-textvqa-test.md>): OCR VQA; TextVQA (test).

- [General VQA on CountBench](<https://www.sota2.com/research/sota/general-vqa-on-countbench.md>): General VQA; CountBench.

- [Temporal VQA on AGQA](<https://www.sota2.com/research/sota/temporal-vqa-on-agqa.md>): Temporal VQA; AGQA.

- [Text-Rich VQA on AI2D](<https://www.sota2.com/research/sota/text-rich-vqa-on-ai2d.md>): Text-Rich VQA; AI2D.

- [element-level commonsense VQA on CommonSketch](<https://www.sota2.com/research/sota/element-level-commonsense-vqa-on-commonsketch.md>): element-level commonsense VQA; CommonSketch.

- [General VQA on VisuLogic](<https://www.sota2.com/research/sota/general-vqa-on-visulogic.md>): General VQA; VisuLogic.
