Object Hallucination Detection on nocaps FOIL (Out-Domain)
89.1APEXPERT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| EXPERTMethod Category=LLM-based2026.05 | 89.1 | 90.8 | 98.7 | |
| BEiTScore-L/14Method Category=Encoder-based, Backbone=BEiT-L/142026.05 | 87 | 88 | 98.3 | |
| VQAScoreMethod Category=LLM-based, Backbone=CLIP-FlanT5-XXL2026.05 | 86.8 | 87.7 | 94.6 | |
| FLEURMethod Category=LLM-based2026.05 | 85.2 | 87 | 96.2 | |
| BEiTScore-B/32Method Category=Encoder-based, Backbone=BEiT-B/322026.05 | 84.5 | 85.1 | 97.2 | |
| LongCLIP-SMethod Category=Encoder-based, Backbone=ViT-L2026.05 | 81.9 | 83.4 | 97.5 | |
| PAC-S++Method Category=Encoder-based, Backbone=ViT-L2026.05 | 79.8 | 82.7 | 97.1 | |
| PAC-SMethod Category=Encoder-based, Backbone=ViT-B2026.05 | 78.7 | 81.9 | 94.6 | |
| LongCLIP-SMethod Category=Encoder-based, Backbone=ViT-B2026.05 | 77 | 79.6 | 95.8 | |
| PAC-S++Method Category=Encoder-based, Backbone=ViT-B2026.05 | 76.9 | 80.7 | 93.7 | |
| PAC-SMethod Category=Encoder-based, Backbone=ViT-L2026.05 | 76.2 | 79.9 | 93.4 | |
| BEiTScore-L/14 w/o Stage 1Method Category=Encoder-based, Backbone=BEiT-L/14, Training Stage=w/o Stage 12026.05 | 76.2 | 78.5 | 95.5 | |
| CLIP-SMethod Category=Encoder-based, Backbone=ViT-L2026.05 | 74.6 | 78.2 | 92.5 | |
| CLIP-SMethod Category=Encoder-based, Backbone=ViT-B2026.05 | 73.8 | 78.6 | 89.5 | |
| BEiTScore-B/32 w/o Stage 1Method Category=Encoder-based, Backbone=BEiT-B/32, Training Stage=w/o Stage 12026.05 | 73.5 | 75.1 | 94 | |
| ALOHaMethod Category=LLM-based2026.05 | 70.9 | — | — | |
| SPECSMethod Category=Encoder-based2026.05 | 69.8 | 72.2 | 96.2 | |
| GPT4o (API)Method Category=LLM-based2026.05 | — | — | 90.9 |