Object Hallucination Evaluation on POPE (Accuracy and F1 Scores)
89.24Accuracy (Random)CAI
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| CAIBackbone=LLaVA-1.5, Latency (ms/token)=131.332026.06 | 89.24 | 89.14 | 86.03 | 85.53 | 82.77 | 82.73 | 86.68 | 85.8 | |
| LVLMs-SaliencyBackbone=LLaVA-1.5, Latency (ms/token)=4294.362026.06 | 89.1 | 88.2 | 87.07 | 86.01 | 83.33 | 83.12 | 86.5 | 85.77 | |
| FarSightBackbone=LLaVA-1.52026.06 | 89.07 | 89.01 | 85.63 | 86.04 | 79.3 | 81.05 | 84.67 | 85.37 | |
| LLaVA-1.5Backbone=LLaVA-1.5, Latency (ms/token)=89.622026.06 | 85.46 | 86.07 | 81.2 | 82.22 | 75.87 | 78.27 | 80.84 | 82.19 | |
| DoLaBackbone=LLaVA-1.52026.06 | 81.77 | 82.09 | 89.17 | 88.54 | 86.37 | 85.98 | 85.77 | 85.54 | |
| SIDBackbone=LLaVA-1.52026.06 | 80.33 | 81.38 | 89.47 | 89.1 | 85.87 | 85.88 | 85.22 | 85.45 |