# POPE

Source: [POPE](<https://www.sota2.com/research/dataset/pope>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Benchmarks

Page 1 of 4. This is an index page, not the full collection.

- [Next index page](<https://www.sota2.com/research/dataset/pope.md?page=2>): Follow this link to discover more pages.

- [Object Hallucination Evaluation on POPE](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope.md>): Object Hallucination Evaluation; POPE.

- [Object Hallucination on POPE Popular](<https://www.sota2.com/research/sota/object-hallucination-on-pope-popular.md>): Object Hallucination; POPE Popular.

- [Object Hallucination on POPE Adversarial](<https://www.sota2.com/research/sota/object-hallucination-on-pope-adversarial.md>): Object Hallucination; POPE Adversarial.

- [Object Hallucination on POPE (Random)](<https://www.sota2.com/research/sota/object-hallucination-on-pope-random.md>): Object Hallucination; POPE (Random).

- [Hallucination Evaluation on POPE](<https://www.sota2.com/research/sota/hallucination-evaluation-on-pope.md>): Hallucination Evaluation; POPE.

- [Object Hallucination Evaluation on POPE (Accuracy Only)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-accuracy-only.md>): Object Hallucination Evaluation; POPE.

- [Object Hallucination Evaluation on MS-COCO (POPE Adversarial)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-ms-coco-pope-adversarial.md>): Object Hallucination Evaluation; MS-COCO (POPE Adversarial).

- [Object Hallucination Evaluation on POPE Adversarial](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-adversarial.md>): Object Hallucination Evaluation; POPE Adversarial.

- [Object Hallucination Evaluation on MS-COCO POPE (Popular)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-ms-coco-pope-popular.md>): Object Hallucination Evaluation; MS-COCO POPE (Popular).

- [Object Hallucination Evaluation on POPE Random](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-random.md>): Object Hallucination Evaluation; POPE Random.

- [Object Hallucination Evaluation on POPE (Accuracy)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-accuracy.md>): Object Hallucination Evaluation; POPE.

- [Visual Question Answering on POPE](<https://www.sota2.com/research/sota/visual-question-answering-on-pope.md>): Visual Question Answering; POPE.

- [Object Hallucination Evaluation on POPE (test)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-test.md>): Object Hallucination Evaluation; POPE (test).

- [Object Hallucination Evaluation on MS-COCO POPE Random](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-ms-coco-pope-random.md>): Object Hallucination Evaluation; MS-COCO POPE Random.

- [Multimodal Understanding on POPE](<https://www.sota2.com/research/sota/multimodal-understanding-on-pope.md>): Multimodal Understanding; POPE.

- [Object Hallucination Evaluation on POPE MSCOCO](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-mscoco.md>): Object Hallucination Evaluation; POPE MSCOCO.

- [Object Hallucination Evaluation on POPE (popular)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-popular.md>): Object Hallucination Evaluation; POPE (popular).

- [Object Hallucination Evaluation on A-OKVQA POPE (Popular)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-a-okvqa-pope-popular.md>): Object Hallucination Evaluation; A-OKVQA POPE (Popular).

- [Object Hallucination Evaluation on POPE GQA](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-gqa.md>): Object Hallucination Evaluation; POPE GQA.

- [Object Hallucination Evaluation on POPE Adversarial offline](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-adversarial-offline.md>): Object Hallucination Evaluation; POPE Adversarial offline.

- [Object Hallucination Evaluation on POPE Popular offline](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-popular-offline.md>): Object Hallucination Evaluation; POPE Popular offline.

- [Object Hallucination Evaluation on POPE Random offline](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-random-offline.md>): Object Hallucination Evaluation; POPE Random offline.

- [Object Hallucination Evaluation on POPE A-OKVQA](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-a-okvqa.md>): Object Hallucination Evaluation; POPE A-OKVQA.

- [Object Hallucination on POPE](<https://www.sota2.com/research/sota/object-hallucination-on-pope.md>): Object Hallucination; POPE.

- [Object Hallucination Evaluation on A-OKVQA POPE (Random)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-a-okvqa-pope-random.md>): Object Hallucination Evaluation; A-OKVQA POPE (Random).

- [Object Hallucination Probing on Style-POPE Popular](<https://www.sota2.com/research/sota/object-hallucination-probing-on-style-pope-popular.md>): Object Hallucination Probing; Style-POPE Popular.

- [Object Hallucination Evaluation on MSCOCO POPE](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-mscoco-pope.md>): Object Hallucination Evaluation; MSCOCO POPE.

- [Object Hallucination Evaluation on POPE GQA Popular](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-gqa-popular.md>): Object Hallucination Evaluation; POPE GQA Popular.

- [Transfer Attack on POPE (test)](<https://www.sota2.com/research/sota/transfer-attack-on-pope-test.md>): Transfer Attack; POPE (test).

- [Object Hallucination Probing on Style-POPE (Random)](<https://www.sota2.com/research/sota/object-hallucination-probing-on-style-pope-random.md>): Object Hallucination Probing; Style-POPE (Random).

- [Object Hallucination Probing on Style-POPE Adversarial](<https://www.sota2.com/research/sota/object-hallucination-probing-on-style-pope-adversarial.md>): Object Hallucination Probing; Style-POPE Adversarial.

- [Object Hallucination Evaluation on A-OKVQA POPE SEEM-annotated](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-a-okvqa-pope-seem-annotated.md>): Object Hallucination Evaluation; A-OKVQA POPE SEEM-annotated.

- [Object Hallucination Evaluation on MSCOCO POPE SEEM-annotated](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-mscoco-pope-seem-annotated.md>): Object Hallucination Evaluation; MSCOCO POPE SEEM-annotated.

- [Object Hallucination Assessment on A-OKVQA POPE (Adversarial)](<https://www.sota2.com/research/sota/object-hallucination-assessment-on-a-okvqa-pope-adversarial.md>): Object Hallucination Assessment; A-OKVQA POPE (Adversarial).

- [Multimodal Understanding on MLLM Evaluation Suite (GQA, ScienceQA-IMG, TextVQA, POPE, MME, MMBench, MM-Vet, MMStar, AI2D, HallusionBench) (test val)](<https://www.sota2.com/research/sota/multimodal-understanding-on-mllm-evaluation-suite-gqa-scienceqa-img-textvqa-pope-mme-mmbench-mm-vet-mmstar-ai2d-hallusionbench-test-val.md>): Multimodal Understanding; MLLM Evaluation Suite GQA, ScienceQA-IMG, TextVQA, POPE, MME, MMBench, MM-Vet, MMStar, AI2D, HallusionBench (test val).

- [Object Hallucination Evaluation on POPE (Rand, Pop, Adv, Avg)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-rand-pop-adv-avg.md>): Object Hallucination Evaluation; POPE.

- [Multi-modal Understanding on LLaVA Multi-modal Evaluation Suite v1.6 (test)](<https://www.sota2.com/research/sota/multi-modal-understanding-on-llava-multi-modal-evaluation-suite-v1-6-test.md>): Multi-modal Understanding; LLaVA Multi-modal Evaluation Suite (GQA, MMB, MME, POPE, SQA, VQAv2, TextVQA, MMMU, SEED-I) v1.6 (test).

- [Object Probing on POPE Average](<https://www.sota2.com/research/sota/object-probing-on-pope-average.md>): Object Probing; POPE Average.

- [Object Hallucination Evaluation on POPE Random, Popular, Adversarial v1.0](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-random-popular-adversarial-v1-0.md>): Object Hallucination Evaluation; POPE Random, Popular, Adversarial v1.0.

- [Image Captioning on POPE Adversarial](<https://www.sota2.com/research/sota/image-captioning-on-pope-adversarial.md>): Image Captioning; POPE Adversarial.

- [Object Hallucination Probing on GQA POPE Popular](<https://www.sota2.com/research/sota/object-hallucination-probing-on-gqa-pope-popular.md>): Object Hallucination Probing; GQA POPE Popular.

- [Visual Question Answering for object probing on POPE Aggregated random, popular, and adversarial](<https://www.sota2.com/research/sota/visual-question-answering-for-object-probing-on-pope-aggregated-random-popular-and-adversarial.md>): Visual Question Answering for object probing; POPE Aggregated random, popular, and adversarial.

- [Visual Question Answering on LLaVA Evaluation Suite (GQA, MMB, MMMU, MME, VQAv2, VQAtext, POPE, SQA, SEED, MMVet)](<https://www.sota2.com/research/sota/visual-question-answering-on-llava-evaluation-suite-gqa-mmb-mmmu-mme-vqav2-vqatext-pope-sqa-seed-mmvet.md>): Visual Question Answering; LLaVA Evaluation Suite GQA, MMB, MMMU, MME, VQAv2, VQAtext, POPE, SQA, SEED, MMVet 1.5 7B (various).

- [Object Hallucination on POPE Adversarial v1.0](<https://www.sota2.com/research/sota/object-hallucination-on-pope-adversarial-v1-0.md>): Object Hallucination; POPE Adversarial v1.0.

- [Discriminative Object Hallucination on POPE MSCOCO Adversarial](<https://www.sota2.com/research/sota/discriminative-object-hallucination-on-pope-mscoco-adversarial.md>): Discriminative Object Hallucination; POPE MSCOCO Adversarial.

- [Hallucination Detection on POPE](<https://www.sota2.com/research/sota/hallucination-detection-on-pope.md>): Hallucination Detection; POPE.

- [Object Hallucination Probing on GQA POPE Random](<https://www.sota2.com/research/sota/object-hallucination-probing-on-gqa-pope-random.md>): Object Hallucination Probing; GQA POPE Random.

- [Object Probing on POPE Adversarial](<https://www.sota2.com/research/sota/object-probing-on-pope-adversarial.md>): Object Probing; POPE Adversarial.

- [Object Probing on POPE Random](<https://www.sota2.com/research/sota/object-probing-on-pope-random.md>): Object Probing; POPE Random.

- [Multimodal Understanding on LLaVA Evaluation Suite (GQA, MMB, MMB-CN, MME, POPE, SQA, VQAV2, VQAText, VizWiz)](<https://www.sota2.com/research/sota/multimodal-understanding-on-llava-evaluation-suite-gqa-mmb-mmb-cn-mme-pope-sqa-vqav2-vqatext-vizwiz.md>): Multimodal Understanding; LLaVA Evaluation Suite GQA, MMB, MMB-CN, MME, POPE, SQA, VQAV2, VQAText, VizWiz.

- [Vision-Language Understanding and Reasoning on LLaVA Multimodal Evaluation Suite 1.5 (test/val)](<https://www.sota2.com/research/sota/vision-language-understanding-and-reasoning-on-llava-multimodal-evaluation-suite-1-5-test-val.md>): Vision-Language Understanding and Reasoning; LLaVA Multimodal Evaluation Suite (GQA, MMBench, MME, POPE, ScienceQA, VQAv2, TextVQA, SEED-Bench, MM-Vet, VizWiz) 1.5 (test/val).

- [Multimodal Understanding on VLM Evaluation Suite (Hall, MME, AI2D, RWQA, SQA, POPE, MBen, MBzh, CCB, VSR, V7W)](<https://www.sota2.com/research/sota/multimodal-understanding-on-vlm-evaluation-suite-hall-mme-ai2d-rwqa-sqa-pope-mben-mbzh-ccb-vsr-v7w.md>): Multimodal Understanding; VLM Evaluation Suite Hall, MME, AI2D, RWQA, SQA, POPE, MBen, MBzh, CCB, VSR, V7W.

- [Visual Hallucination Evaluation on POPE MS-COCO Adversarial sampling (val)](<https://www.sota2.com/research/sota/visual-hallucination-evaluation-on-pope-ms-coco-adversarial-sampling-val.md>): Visual Hallucination Evaluation; POPE MS-COCO Adversarial sampling (val).

- [Object Hallucination Evaluation on POPE (average across random and popular)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-average-across-random-and-popular.md>): Object Hallucination evaluation; POPE (average across random and popular).

- [Multimodal Understanding on LVLM Evaluation Suite (AI2D, DocVQA, InfoVQA, MMBench, MME, MMMU, SciQA, TextVQA, MMStar, POPE)](<https://www.sota2.com/research/sota/multimodal-understanding-on-lvlm-evaluation-suite-ai2d-docvqa-infovqa-mmbench-mme-mmmu-sciqa-textvqa-mmstar-pope.md>): Multimodal Understanding; LVLM Evaluation Suite (AI2D, DocVQA, InfoVQA, MMBench, MME, MMMU, SciQA, TextVQA, MMStar, POPE).

- [Object Hallucination Detection on POPE (average over three sampling strategies)](<https://www.sota2.com/research/sota/object-hallucination-detection-on-pope-average-over-three-sampling-strategies.md>): Object Hallucination Detection; POPE average over three sampling strategies.

- [Object Hallucination Evaluation on POPE GQA (Adversarial)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-gqa-adversarial.md>): Object Hallucination Evaluation; POPE GQA (Adversarial).

- [Hallucination Detection on POPE official (val)](<https://www.sota2.com/research/sota/hallucination-detection-on-pope-official-val.md>): Hallucination Detection; POPE official (val).

- [Multi-task Adversarial Attack Evaluation on COCO, Flickr30k, TextVQA, VQAv2, POPE](<https://www.sota2.com/research/sota/multi-task-adversarial-attack-evaluation-on-coco-flickr30k-textvqa-vqav2-pope.md>): Multi-task Adversarial Attack Evaluation; COCO, Flickr30k, TextVQA, VQAv2, POPE.

- [Object Hallucination Evaluation on POPE (Accuracy, F1, Precision, Recall)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-accuracy-f1-precision-recall.md>): Object Hallucination Evaluation; POPE.

- [Multimodal Understanding on MLLM Evaluation Suite (HallusionBench, MME, AI2D, RWQA, SQA, POPE, MMBench, CCB, VSR, V7W) (test)](<https://www.sota2.com/research/sota/multimodal-understanding-on-mllm-evaluation-suite-hallusionbench-mme-ai2d-rwqa-sqa-pope-mmbench-ccb-vsr-v7w-test.md>): Multimodal Understanding; MLLM Evaluation Suite (HallusionBench, MME, AI2D, RWQA, SQA, POPE, MMBench, CCB, VSR, V7W) (test).

- [Object Hallucination on MSCOCO POPE (test)](<https://www.sota2.com/research/sota/object-hallucination-on-mscoco-pope-test.md>): Object Hallucination; MSCOCO POPE (test).

- [Hallucination Evaluation on POPE Adversarial v1.0 (test)](<https://www.sota2.com/research/sota/hallucination-evaluation-on-pope-adversarial-v1-0-test.md>): Hallucination Evaluation; POPE Adversarial v1.0 (test).

- [Hallucination Evaluation on POPE Popular v1.0 (test)](<https://www.sota2.com/research/sota/hallucination-evaluation-on-pope-popular-v1-0-test.md>): Hallucination Evaluation; POPE Popular v1.0 (test).

- [Hallucination Evaluation on POPE Random v1.0 (test)](<https://www.sota2.com/research/sota/hallucination-evaluation-on-pope-random-v1-0-test.md>): Hallucination Evaluation; POPE Random v1.0 (test).

- [Transfer Attack on POPE](<https://www.sota2.com/research/sota/transfer-attack-on-pope.md>): Transfer Attack; POPE.

- [Discriminative Object Hallucination on POPE MSCOCO Popular](<https://www.sota2.com/research/sota/discriminative-object-hallucination-on-pope-mscoco-popular.md>): Discriminative Object Hallucination; POPE MSCOCO Popular.

- [Discriminative Object Hallucination on POPE MSCOCO (Random)](<https://www.sota2.com/research/sota/discriminative-object-hallucination-on-pope-mscoco-random.md>): Discriminative Object Hallucination; POPE MSCOCO (Random).

- [Object Hallucination Evaluation on POPE GQA (test)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-gqa-test.md>): Object Hallucination Evaluation; POPE GQA (test).

- [Object Hallucination on A-OKVQA POPE (test)](<https://www.sota2.com/research/sota/object-hallucination-on-a-okvqa-pope-test.md>): Object Hallucination; A-OKVQA POPE (test).

- [Multimodal Visual Question Answering and Reasoning on LLaVA Evaluation Suite 1.5](<https://www.sota2.com/research/sota/multimodal-visual-question-answering-and-reasoning-on-llava-evaluation-suite-1-5.md>): Multimodal Visual Question Answering and Reasoning; LLaVA Evaluation Suite (GQA, SQA-IMG, VQA-Text, POPE, MME, MMBench-EN, MMBench-CN, MM-Vet) 1.5.

- [Multimodal Understanding and Question Answering on LLaVA-NeXT Evaluation Suite 13B (test)](<https://www.sota2.com/research/sota/multimodal-understanding-and-question-answering-on-llava-next-evaluation-suite-13b-test.md>): Multimodal Understanding and Question Answering; LLaVA-NeXT Evaluation Suite (GQA, SQA-IMG, VQA-Text, POPE, MME, MMB-EN, MMB-CN, MMVet) 13B (test).

- [Multimodal Question Answering and Reasoning on LMM Evaluation Suite (GQA, SQA-IMG, VQA-Text, POPE, MME, MMBench, MM-Vet) (test val)](<https://www.sota2.com/research/sota/multimodal-question-answering-and-reasoning-on-lmm-evaluation-suite-gqa-sqa-img-vqa-text-pope-mme-mmbench-mm-vet-test-val.md>): Multimodal Question Answering and Reasoning; LMM Evaluation Suite (GQA, SQA-IMG, VQA-Text, POPE, MME, MMBench, MM-Vet) (test val).

- [Object Hallucination Detection on POPE popular](<https://www.sota2.com/research/sota/object-hallucination-detection-on-pope-popular.md>): Object Hallucination Detection; POPE popular.

- [Multimodal Question Answering and Understanding on Standard Multimodal Evaluation Suite (GQA, MMB, MME, VQA-T, SQA-I, VQA-v2, POPE, MMMU, MM-Vet)](<https://www.sota2.com/research/sota/multimodal-question-answering-and-understanding-on-standard-multimodal-evaluation-suite-gqa-mmb-mme-vqa-t-sqa-i-vqa-v2-pope-mmmu-mm-vet.md>): Multimodal Question Answering and Understanding; Standard Multimodal Evaluation Suite GQA, MMB, MME, VQA-T, SQA-I, VQA-v2, POPE, MMMU, MM-Vet.

- [Object Hallucination Evaluation on POPE averaged across MS-COCO, A-OKVQA, and GQA (test)](<https://www.sota2.com/research/sota/object-hallucination-evaluation-on-pope-averaged-across-ms-coco-a-okvqa-and-gqa-test.md>): Object Hallucination Evaluation; POPE averaged across MS-COCO, A-OKVQA, and GQA (test).

- [Multimodal Image Understanding on LLaVA-1.5-7B Evaluation Suite](<https://www.sota2.com/research/sota/multimodal-image-understanding-on-llava-1-5-7b-evaluation-suite.md>): Multimodal Image Understanding; LLaVA-1.5-7B Evaluation Suite (GQA, MMBench, MMBench-CN, MME, POPE, ScienceQA, TextVQA, VizWiz, MM-Vet).

- [Object Hallucination on POPE (Random/Popular/Adversarial Metrics)](<https://www.sota2.com/research/sota/object-hallucination-on-pope-random-popular-adversarial-metrics.md>): Object Hallucination; POPE.

- [Vision-Language Perception on VL Perception Benchmarks TextVQA, POPE, Seed-Bench](<https://www.sota2.com/research/sota/vision-language-perception-on-vl-perception-benchmarks-textvqa-pope-seed-bench.md>): Vision-Language Perception; VL Perception Benchmarks TextVQA, POPE, Seed-Bench.

- [Visual Question Answering on POPE GQA](<https://www.sota2.com/research/sota/visual-question-answering-on-pope-gqa.md>): Visual Question Answering; POPE GQA.
