Sequential Image Hallucination Assessment on Mementos Object and Behavior
48.15Mementos Object FidelitySIMA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SIMABase Model=VILA-7B2024.05 | 48.15 | 27.04 | |
| SIMABase Model=LLaVA-1.5-7B2024.05 | 46.08 | 26.03 | |
| SIMABase Model=LLaVA-1.5-13B2024.05 | 45.84 | 27.17 | |
| GT-DPOBase Model=VILA-7B2024.05 | 44.25 | 26.91 | |
| GT-DPOBase Model=LLaVA-1.5-7B2024.05 | 43.67 | 24.35 | |
| POVIDBase Model=LLaVA-1.5-7B2024.05 | 42.95 | 23.84 | |
| GT-DPOBase Model=LLaVA-1.5-13B2024.05 | 42.59 | 25.84 | |
| VILA-7BBase Model=None2024.05 | 41.96 | 25.88 | |
| HA-DPOBase Model=LLaVA-1.5-7B2024.05 | 41.07 | 23.58 | |
| RLHFBase Model=LLaVA-1.5-7B2024.05 | 40.53 | 22.71 | |
| LLaVA-1.5-13BBase Model=None2024.05 | 40.37 | 24.65 | |
| LLaVA-1.5-7BBase Model=None2024.05 | 39.29 | 23.02 |