Object Hallucination Evaluation on POPE (F1 Score)
85.9F1 ScoreVanilla
Evaluation results
| Method | Links | |
|---|---|---|
| VanillaBase Model=LLaVA-1.5-13B, Retain Tokens=576, Retention Ratio=100%2026.06 | 85.9 | |
| PDropBase Model=LLaVA-1.5-13B, Retain Tokens=192, Retention Ratio=↓ 66.7%2026.06 | 85 | |
| CLSEBase Model=LLaVA-1.5-13B, Retain Tokens=192, Retention Ratio=↓ 66.7%2026.06 | 85 | |
| CLSEBase Model=LLaVA-1.5-13B, Retain Tokens=128, Retention Ratio=↓ 77.8%2026.06 | 82.9 | |
| FastVBase Model=LLaVA-1.5-13B, Retain Tokens=192, Retention Ratio=↓ 66.7%2026.06 | 82.3 | |
| PDropBase Model=LLaVA-1.5-13B, Retain Tokens=128, Retention Ratio=↓ 77.8%2026.06 | 82.3 | |
| SparseVLMBase Model=LLaVA-1.5-13B, Retain Tokens=192, Retention Ratio=↓ 66.7%2026.06 | 82.2 | |
| FiCoCo-VBase Model=LLaVA-1.5-13B, Retain Tokens=192, Retention Ratio=↓ 66.7%2026.06 | 81.4 | |
| SparseVLMBase Model=LLaVA-1.5-13B, Retain Tokens=128, Retention Ratio=↓ 77.8%2026.06 | 81.1 | |
| FastVBase Model=LLaVA-1.5-13B, Retain Tokens=128, Retention Ratio=↓ 77.8%2026.06 | 79.3 | |
| FiCoCo-VBase Model=LLaVA-1.5-13B, Retain Tokens=128, Retention Ratio=↓ 77.8%2026.06 | 77.3 | |
| CLSEBase Model=LLaVA-1.5-13B, Retain Tokens=64, Retention Ratio=↓ 88.9%2026.06 | 75.9 | |
| FiCoCo-VBase Model=LLaVA-1.5-13B, Retain Tokens=64, Retention Ratio=↓ 88.9%2026.06 | 70.9 | |
| FastVBase Model=LLaVA-1.5-13B, Retain Tokens=64, Retention Ratio=↓ 88.9%2026.06 | 69.3 | |
| SparseVLMBase Model=LLaVA-1.5-13B, Retain Tokens=64, Retention Ratio=↓ 88.9%2026.06 | 65 | |
| PDropBase Model=LLaVA-1.5-13B, Retain Tokens=64, Retention Ratio=↓ 88.9%2026.06 | 62.6 |