Self-evaluation on MMVet (AUROC)
0.886AUROCVAUQ
Evaluation Results
| Method | Links | |
|---|---|---|
| VAUQModel=LLaVA-1.5-13B2026.02 | 0.886 | |
| Semantic EntropyModel=LLaVA-1.5-13B2026.02 | 0.864 | |
| VL-UncertaintyModel=LLaVA-1.5-13B2026.02 | 0.859 | |
| EigenScoreModel=LLaVA-1.5-13B2026.02 | 0.851 | |
| VL-UncertaintyModel=LLaVA-1.5-7B2026.02 | 0.823 | |
| VAUQModel=LLaVA-1.5-7B2026.02 | 0.815 | |
| Semantic EntropyModel=LLaVA-1.5-7B2026.02 | 0.813 | |
| PerplexityModel=LLaVA-1.5-13B2026.02 | 0.813 | |
| PerplexityModel=LLaVA-1.5-7B2026.02 | 0.793 | |
| VAUQBackbone=Qwen-2.5-VL-7B2026.02 | 0.783 | |
| EigenScoreModel=LLaVA-1.5-7B2026.02 | 0.782 | |
| PerplexityBackbone=Qwen-2.5-VL-7B2026.02 | 0.766 | |
| VAUQBackbone=InternVL3.5-8B2026.02 | 0.758 | |
| VL-UncertaintyBackbone=InternVL3.5-8B2026.02 | 0.757 | |
| VerbalizedModel=LLaVA-1.5-7B2026.02 | 0.717 | |
| Contextual LensModel=LLaVA-1.5-7B2026.02 | 0.708 | |
| Semantic EntropyBackbone=InternVL3.5-8B2026.02 | 0.704 | |
| VL-UncertaintyBackbone=Qwen-2.5-VL-7B2026.02 | 0.697 | |
| PerplexityBackbone=InternVL3.5-8B2026.02 | 0.675 | |
| VerbalizedModel=LLaVA-1.5-13B2026.02 | 0.672 | |
| Contextual LensBackbone=Qwen-2.5-VL-7B2026.02 | 0.655 | |
| EigenScoreBackbone=InternVL3.5-8B2026.02 | 0.641 | |
| Contextual LensModel=LLaVA-1.5-13B2026.02 | 0.614 | |
| Chain-of-EmbeddingsModel=LLaVA-1.5-7B2026.02 | 0.608 | |
| EigenScoreBackbone=Qwen-2.5-VL-7B2026.02 | 0.608 | |
| Semantic EntropyBackbone=Qwen-2.5-VL-7B2026.02 | 0.601 | |
| Chain-of-EmbeddingsBackbone=Qwen-2.5-VL-7B2026.02 | 0.598 | |
| Contextual LensBackbone=InternVL3.5-8B2026.02 | 0.596 | |
| VerbalizedBackbone=InternVL3.5-8B2026.02 | 0.594 | |
| SVARBackbone=Qwen-2.5-VL-7B2026.02 | 0.546 | |
| Chain-of-EmbeddingsBackbone=InternVL3.5-8B2026.02 | 0.528 | |
| VerbalizedBackbone=Qwen-2.5-VL-7B2026.02 | 0.519 | |
| SVARBackbone=InternVL3.5-8B2026.02 | 0.497 | |
| Chain-of-EmbeddingsModel=LLaVA-1.5-13B2026.02 | 0.444 | |
| SVARModel=LLaVA-1.5-13B2026.02 | 0.342 | |
| SVARModel=LLaVA-1.5-7B2026.02 | 0.293 |