# RealworldQA

Source: [RealworldQA](<https://www.sota2.com/research/dataset/realworldqa>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 1. This is an index page, not the full collection.

- [Visual Question Answering on RealworldQA](<https://www.sota2.com/research/sota/visual-question-answering-on-realworldqa.md>): Visual Question Answering; RealworldQA.

- [Real-world Visual Question Answering on RealWorldQA](<https://www.sota2.com/research/sota/real-world-visual-question-answering-on-realworldqa.md>): Real-world Visual Question Answering; RealWorldQA.

- [Real-world Visual Understanding on RealWorldQA](<https://www.sota2.com/research/sota/real-world-visual-understanding-on-realworldqa.md>): Real-world Visual Understanding; RealWorldQA.

- [Real-world QA on RealworldQA](<https://www.sota2.com/research/sota/real-world-qa-on-realworldqa.md>): Real-world QA; RealworldQA.

- [Vision-centric Reasoning on RealWorldQA](<https://www.sota2.com/research/sota/vision-centric-reasoning-on-realworldqa.md>): Vision-centric Reasoning; RealWorldQA.

- [General Visual Understanding on RealWorldQA](<https://www.sota2.com/research/sota/general-visual-understanding-on-realworldqa.md>): General Visual Understanding; RealWorldQA.

- [Real-world Multimodal Reasoning on RealWorldQA](<https://www.sota2.com/research/sota/real-world-multimodal-reasoning-on-realworldqa.md>): Real-world Multimodal Reasoning; RealWorldQA.

- [Real-world Question Answering on RealWorldQA](<https://www.sota2.com/research/sota/real-world-question-answering-on-realworldqa.md>): Real-world Question Answering; RealWorldQA.

- [Spatial Reasoning on RealWorldQA](<https://www.sota2.com/research/sota/spatial-reasoning-on-realworldqa.md>): Spatial Reasoning; RealWorldQA.

- [Visual Question Answering on RealWorldQA (test)](<https://www.sota2.com/research/sota/visual-question-answering-on-realworldqa-test.md>): Visual Question Answering; RealWorldQA (test).

- [Multimodal Reasoning on RealWorldQA (Acc, Acpt, Speedup)](<https://www.sota2.com/research/sota/multimodal-reasoning-on-realworldqa-acc-acpt-speedup.md>): Multimodal Reasoning; RealWorldQA.

- [Multimodal Reasoning on RealWorldQA](<https://www.sota2.com/research/sota/multimodal-reasoning-on-realworldqa.md>): Multimodal Reasoning; RealWorldQA.

- [Real-world Visual Understanding on RealWorldQA (Score Metric)](<https://www.sota2.com/research/sota/real-world-visual-understanding-on-realworldqa-score-metric.md>): Real-world Visual Understanding; RealWorldQA.

- [Perception and Reasoning on RealWorldQA](<https://www.sota2.com/research/sota/perception-and-reasoning-on-realworldqa.md>): Perception and Reasoning; RealWorldQA.

- [Image Understanding on Multimodal Suite (TextVQA, ChartQA, MMStar, MMBench, MMVet, MME, RealWorldQA, COCO)](<https://www.sota2.com/research/sota/image-understanding-on-multimodal-suite-textvqa-chartqa-mmstar-mmbench-mmvet-mme-realworldqa-coco.md>): Image Understanding; Image Understanding Suite (TextVQA, ChartQA, MMStar, MMBench, MMVet, MME, RealWorldQA, COCO).

- [Multimodal Understanding and QA on MME, OCRBench, DocVQA, RealWorldQA, and VLMBlind](<https://www.sota2.com/research/sota/multimodal-understanding-and-qa-on-mme-ocrbench-docvqa-realworldqa-and-vlmblind.md>): Multimodal Understanding and Question Answering; Multimodal Benchmarks MME, OCRBench, DocVQA, RealWorldQA, VLMBlind.

- [Multimodal Understanding on RealWorldQA](<https://www.sota2.com/research/sota/multimodal-understanding-on-realworldqa.md>): Multimodal Understanding; RealWorldQA.

- [Visual Question Answering on RealWorldQA xAI 2024 (test)](<https://www.sota2.com/research/sota/visual-question-answering-on-realworldqa-xai-2024-test.md>): Visual Question Answering; RealWorldQA xAI 2024 (test).

- [General Visual Question Answering on RealWorldQA](<https://www.sota2.com/research/sota/general-visual-question-answering-on-realworldqa.md>): General Visual Question Answering; RealWorldQA.

- [Real-world Visual Understanding on RealWorldQA (test)](<https://www.sota2.com/research/sota/real-world-visual-understanding-on-realworldqa-test.md>): Real-world Visual Understanding; RealWorldQA (test).

- [Spatial Understanding on RealWorldQA](<https://www.sota2.com/research/sota/spatial-understanding-on-realworldqa.md>): Spatial Understanding; RealWorldQA.

- [Visual Question Answering on RealWorldQA (RWQA)](<https://www.sota2.com/research/sota/visual-question-answering-on-realworldqa-rwqa.md>): Visual Question Answering; RealWorldQA (RWQA).

- [General Visual Question Answering on RealWorldQA (Accuracy)](<https://www.sota2.com/research/sota/general-visual-question-answering-on-realworldqa-accuracy.md>): General Visual Question Answering; RealWorldQA.

- [General Utility on RealWorldQA](<https://www.sota2.com/research/sota/general-utility-on-realworldqa.md>): General Utility; RealWorldQA.

- [Real-world Multimodal Understanding on RealWorldQA (Accuracy)](<https://www.sota2.com/research/sota/real-world-multimodal-understanding-on-realworldqa-accuracy.md>): Real-world Multimodal Understanding; RealWorldQA.

- [General Reasoning & Understanding on RealWorldQA (accuracy)](<https://www.sota2.com/research/sota/general-reasoning-and-understanding-on-realworldqa-accuracy.md>): General Reasoning & Understanding; RealWorldQA.

- [Real-world Multimodal Interaction on RealWorldQA (test)](<https://www.sota2.com/research/sota/real-world-multimodal-interaction-on-realworldqa-test.md>): Real-world Multimodal Interaction; RealWorldQA (test).

- [Vision Understanding on RealworldQA](<https://www.sota2.com/research/sota/vision-understanding-on-realworldqa.md>): Vision Understanding; RealworldQA.

- [Multimodal Reasoning on RealWorldQA (test)](<https://www.sota2.com/research/sota/multimodal-reasoning-on-realworldqa-test.md>): Multimodal Reasoning; RealWorldQA (test).

- [Vision-Centric Perception on RealWorldQA](<https://www.sota2.com/research/sota/vision-centric-perception-on-realworldqa.md>): Vision-Centric Perception; RealWorldQA.

- [Real-world Perception on RealWorldQA](<https://www.sota2.com/research/sota/real-world-perception-on-realworldqa.md>): Real-world Perception; RealWorldQA.

- [Multimodal Understanding on HallusionBench, MME, AI2D, RealWorldQA, ScienceQA, POPE, MMBench (EN/CN), CCBench, Visual Spatial Reasoning, Visual7W (test)](<https://www.sota2.com/research/sota/multimodal-understanding-on-hallusionbench-mme-ai2d-realworldqa-scienceqa-pope-mmbench-en-cn-ccbench-visual-spatial-reasoning-visual7w-test.md>): Multimodal Understanding; HallusionBench, MME, AI2D, RealWorldQA, ScienceQA, POPE, MMBench (EN/CN), CCBench, Visual Spatial Reasoning, Visual7W (test).

- [Multimodal Understanding on AI2D, POPE, TextVQA, OKVQA, VizWiz, COCO Caption, NoCaps, and RealWorldQA](<https://www.sota2.com/research/sota/multimodal-understanding-on-ai2d-pope-textvqa-okvqa-vizwiz-coco-caption-nocaps-and-realworldqa.md>): Multimodal Understanding; AI2D, POPE, TextVQA, OKVQA, VizWiz, COCO Caption, NoCaps, and RealWorldQA Average.

- [Real-world Multimodal Interaction on RealWorldQA](<https://www.sota2.com/research/sota/real-world-multimodal-interaction-on-realworldqa.md>): Real-world Multimodal Interaction; RealWorldQA.

- [Visual Question Answering on RealWorldQA 1.0 (test)](<https://www.sota2.com/research/sota/visual-question-answering-on-realworldqa-1-0-test.md>): Visual Question Answering; RealWorldQA 1.0 (test).

- [Multimodal Understanding and Reasoning on HallBench, MME, TextVQA, ChartQA, AI2D, RealWorldQA, CCBench, OCRVQA, SQA-IMG, POPE](<https://www.sota2.com/research/sota/multimodal-understanding-and-reasoning-on-hallbench-mme-textvqa-chartqa-ai2d-realworldqa-ccbench-ocrvqa-sqa-img-pope.md>): Multimodal Understanding and Reasoning; Image Benchmarks HallBench, MME, TextVQA, ChartQA, AI2D, RealWorldQA, CCBench, OCRVQA, SQA-IMG, POPE.

- [Vision-Centric Understanding on RealworldQA](<https://www.sota2.com/research/sota/vision-centric-understanding-on-realworldqa.md>): Vision-Centric Understanding; RealworldQA.

- [Short-answer Visual Question Answering on RealWorldQA](<https://www.sota2.com/research/sota/short-answer-visual-question-answering-on-realworldqa.md>): Short-answer Visual Question Answering; RealWorldQA.

- [Real-world understanding on RealWorldQA (Score)](<https://www.sota2.com/research/sota/real-world-understanding-on-realworldqa-score.md>): Real-world understanding; RealWorldQA.

- [Spatial & Vision Grounding on RealWorldQA](<https://www.sota2.com/research/sota/spatial-and-vision-grounding-on-realworldqa.md>): Spatial & Vision Grounding; RealWorldQA.

- [Multiple-choice Question Answering on RealWorldQA](<https://www.sota2.com/research/sota/multiple-choice-question-answering-on-realworldqa.md>): Multiple-choice Question Answering; RealWorldQA.

- [Visual Reasoning on RealWorldQA 2024 (test)](<https://www.sota2.com/research/sota/visual-reasoning-on-realworldqa-2024-test.md>): Visual Reasoning; RealWorldQA 2024 (test).

- [Real-world perception-centric reasoning on RealWorldQA (test)](<https://www.sota2.com/research/sota/real-world-perception-centric-reasoning-on-realworldqa-test.md>): Real-world perception-centric reasoning; RealWorldQA (test).

- [Multimodal Reasoning on MathVista, WeMath, ChartQA, LogicVista, MMStar, VisPuzzles, RealWorldQA (Unseen Degradations 8B model)](<https://www.sota2.com/research/sota/multimodal-reasoning-on-mathvista-wemath-chartqa-logicvista-mmstar-vispuzzles-realworldqa-unseen-degradations-8b-model.md>): Multimodal Reasoning; MathVista, WeMath, ChartQA, LogicVista, MMStar, VisPuzzles, RealWorldQA Unseen Degradations 8B model.

- [Multimodal Reasoning on MathVista, WeMath, ChartQA, LogicVista, MMStar, VisPuzzles, RealWorldQA (Seen Degradations 8B model)](<https://www.sota2.com/research/sota/multimodal-reasoning-on-mathvista-wemath-chartqa-logicvista-mmstar-vispuzzles-realworldqa-seen-degradations-8b-model.md>): Multimodal Reasoning; MathVista, WeMath, ChartQA, LogicVista, MMStar, VisPuzzles, RealWorldQA Seen Degradations 8B model.

- [Multimodal Reasoning on MathVista, WeMath, ChartQA, LogicVista, MMStar, VisPuzzles, and RealWorldQA](<https://www.sota2.com/research/sota/multimodal-reasoning-on-mathvista-wemath-chartqa-logicvista-mmstar-vispuzzles-and-realworldqa.md>): Multimodal Reasoning; MathVista, WeMath, ChartQA, LogicVista, MMStar, VisPuzzles, RealWorldQA 8B model (Clean).

- [Multi-modal Understanding on CV-Bench, BLINK, RealWorldQA, MathVista, MMStar, MMVet Suite](<https://www.sota2.com/research/sota/multi-modal-understanding-on-cv-bench-blink-realworldqa-mathvista-mmstar-mmvet-suite.md>): Multi-modal Understanding; CV-Bench, BLINK, RealWorldQA, MathVista, MMStar, MMVet.

- [Visual Question Answering (Perception) on CV-Bench, BLINK, and RealWorldQA](<https://www.sota2.com/research/sota/visual-question-answering-perception-on-cv-bench-blink-and-realworldqa.md>): Visual Question Answering (Perception); CV-Bench, BLINK, RealWorldQA.

- [Perception & Recognition on RealWorldQA](<https://www.sota2.com/research/sota/perception-and-recognition-on-realworldqa.md>): Perception & Recognition; RealWorldQA.

- [General Visual Understanding on RealWorldQA and MMStar](<https://www.sota2.com/research/sota/general-visual-understanding-on-realworldqa-and-mmstar.md>): General Visual Understanding; General Visual Benchmarks RealWorldQA, MMStar.

- [Multimodal Question Answering on MLLM Evaluation Suite (HallBench, MME, TextVQA, ChartQA, AI2D, RealWorldQA, CCBench, OCRVQA, SQA-IMG, POPE) (test)](<https://www.sota2.com/research/sota/multimodal-question-answering-on-mllm-evaluation-suite-hallbench-mme-textvqa-chartqa-ai2d-realworldqa-ccbench-ocrvqa-sqa-img-pope-test.md>): Multimodal Question Answering; MLLM Evaluation Suite (HallBench, MME, TextVQA, ChartQA, AI2D, RealWorldQA, CCBench, OCRVQA, SQA-IMG, POPE) (test).

- [Real-world Image QA on RealworldQA](<https://www.sota2.com/research/sota/real-world-image-qa-on-realworldqa.md>): Real-world Image QA; RealworldQA.

- [Real-world QA on RealworldQA v1.0 (test)](<https://www.sota2.com/research/sota/real-world-qa-on-realworldqa-v1-0-test.md>): Real-world QA; RealworldQA v1.0 (test).

- [Visual Understanding on RealWorldQA](<https://www.sota2.com/research/sota/visual-understanding-on-realworldqa.md>): Visual Understanding; RealWorldQA.

- [Visual Question Answering on RealWorldQA 2024](<https://www.sota2.com/research/sota/visual-question-answering-on-realworldqa-2024.md>): Visual Question Answering; RealWorldQA 2024.

- [General Visual Question Answering on RealWorldQA (Pass@1)](<https://www.sota2.com/research/sota/general-visual-question-answering-on-realworldqa-pass-at-1.md>): General visual question answering; RealWorldQA.

- [General Visual Question Answering on RealWorldQA (avg)](<https://www.sota2.com/research/sota/general-visual-question-answering-on-realworldqa-avg.md>): General Visual Question Answering; RealWorldQA (avg).

- [Fine-grained Visual Perception on RealWorldQA](<https://www.sota2.com/research/sota/fine-grained-visual-perception-on-realworldqa.md>): Fine-grained Visual Perception; RealWorldQA.

- [Spatial Understanding on RealWorldQA (Accuracy %)](<https://www.sota2.com/research/sota/spatial-understanding-on-realworldqa-accuracy-percent.md>): Spatial Understanding; RealWorldQA.

- [General Visual Question Answering on RealWorldQA 2024](<https://www.sota2.com/research/sota/general-visual-question-answering-on-realworldqa-2024.md>): General Visual Question Answering; RealWorldQA 2024.

- [Multimodal Perception on RealWorldQA](<https://www.sota2.com/research/sota/multimodal-perception-on-realworldqa.md>): Multimodal Perception; RealWorldQA.

- [Multimodal Understanding on RealWorldQA (mean@8 acc %)](<https://www.sota2.com/research/sota/multimodal-understanding-on-realworldqa-mean-at-8-acc-percent.md>): Multimodal Understanding; RealWorldQA.

- [Real-World Understanding on RealWorldQA, MME-RW, and R-Bench](<https://www.sota2.com/research/sota/real-world-understanding-on-realworldqa-mme-rw-and-r-bench.md>): Real-World Understanding; Real-world Understanding (RealWorldQA, MME-RW, R-Bench).

- [Vision-centric perception on RealWorldQA 90](<https://www.sota2.com/research/sota/vision-centric-perception-on-realworldqa-90.md>): Vision-centric perception; RealWorldQA 90.

- [Overall Performance Evaluation on MLLM Component Suite (MME, MMStar, SQA, RealWorldQA, MMMU, MMMU-P, VisuLogic, LogicVista, CRPE, POPE, HallBench)](<https://www.sota2.com/research/sota/overall-performance-evaluation-on-mllm-component-suite-mme-mmstar-sqa-realworldqa-mmmu-mmmu-p-visulogic-logicvista-crpe-pope-hallbench.md>): Overall Performance Evaluation; Combined Suite (MME, MMStar, SQA, RealWorldQA, MMMU, MMMU-P, VisuLogic, LogicVista, CRPE, POPE, HallBench).

- [General on RealWorldQA](<https://www.sota2.com/research/sota/general-on-realworldqa.md>): General; RealWorldQA.

- [Multimodal Large Language Model Evaluation on MLLM Evaluation Suite (test)](<https://www.sota2.com/research/sota/multimodal-large-language-model-evaluation-on-mllm-evaluation-suite-test.md>): Multimodal Large Language Model Evaluation; MLLM Evaluation Suite (MME, MMStar, SQA, RealWorldQA, MMMU, MMMU-P, VisuLogic, LogicVista, CRPE, POPE, HallBench) (test).

- [Visual Question Answering on MMMU, RealWorldQA, BLINK, and MMT](<https://www.sota2.com/research/sota/visual-question-answering-on-mmmu-realworldqa-blink-and-mmt.md>): Visual Question Answering; General Bench MMMU, RealWorldQA, BLINK, MMT.

- [Multimodal Hallucination and Real-world Evaluation on RealWorldQA](<https://www.sota2.com/research/sota/multimodal-hallucination-and-real-world-evaluation-on-realworldqa.md>): Multimodal Hallucination and Real-world Evaluation; RealWorldQA.

- [Visual Question Answering on RealWorldQA (Efficiency)](<https://www.sota2.com/research/sota/visual-question-answering-on-realworldqa-efficiency.md>): Visual Question Answering; RealWorldQA.

- [Real-world Visual Question Answering on RealWorldQA zero-shot](<https://www.sota2.com/research/sota/real-world-visual-question-answering-on-realworldqa-zero-shot.md>): Real-world Visual Question Answering; RealWorldQA zero-shot.
