Visual Hallucination Evaluation on AMBER Discriminative (Acc, Prec, Rec, F1)
89AccuracyHeRA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| HeRABackbone=Qwen3-8B2026.06 | 89 | 92.4 | 90.9 | 91.6 | |
| HeRABackbone=Qwen2.5-14B2026.06 | 89 | 90.4 | 93.4 | 91.9 | |
| HeRABackbone=Qwen3-14B2026.06 | 88.9 | 90.7 | 92.7 | 91.7 | |
| Qwen3-14BBackbone=Qwen3-14B2026.06 | 88.8 | 91.6 | 91.5 | 91.5 | |
| HeRABackbone=Qwen2.5-7B2026.06 | 87.7 | 89.1 | 92.8 | 90.9 | |
| Qwen2.5-7BBackbone=Qwen2.5-7B2026.06 | 87.6 | 89.6 | 91.9 | 90.7 | |
| Qwen3-8BBackbone=Qwen3-8B2026.06 | 87.3 | 90.3 | 90.6 | 90.4 | |
| Qwen3-4BBackbone=Qwen3-4B2026.06 | 86.5 | 89.9 | 89.6 | 89.7 | |
| HeRABackbone=Qwen3-4B2026.06 | 86.5 | 90.1 | 89.4 | 89.7 | |
| Qwen2.5-14BBackbone=Qwen2.5-14B2026.06 | 86.2 | 87.9 | 91.8 | 89.8 | |
| HeRABackbone=Vicuna-7B2026.06 | 85.9 | 90.8 | 87.7 | 89.2 | |
| LLama3-8BBackbone=LLama3-8B2026.06 | 85.9 | 89.2 | 89.6 | 89.4 | |
| HeRABackbone=LLama3-8B2026.06 | 85.9 | 88.3 | 90.8 | 89.5 | |
| HeRABackbone=Vicuna-13B2026.06 | 85.7 | 91.7 | 86.2 | 88.9 | |
| HeRABackbone=Qwen2.5-3B2026.06 | 85.6 | 86.5 | 92.8 | 89.5 | |
| Vicuna-13BBackbone=Vicuna-13B2026.06 | 84.8 | 93.9 | 82.4 | 87.8 | |
| Vicuna-7BBackbone=Vicuna-7B2026.06 | 84.2 | 90 | 85.8 | 87.8 | |
| Qwen2.5-3BBackbone=Qwen2.5-3B2026.06 | 83.6 | 83.9 | 93.2 | 88.3 |