Unknown entity vs. Visual evidence failure Classification on PopVQA and iNaturalist Attribution Tree
98.4GemmaVIS
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VISFeature Category=Pre-gen. features, Head=Lin.2026.07 | 98.4 | 99.7 | 90.7 | 99.3 | 97 | |
| ATTN+LAST8Feature Category=Pre-gen. features, Head=Lin.2026.07 | 68.4 | 67 | 62.6 | 72.3 | 67.6 | |
| LAST8Feature Category=Pre-gen. features, Head=Lin.2026.07 | 67.2 | 65.5 | 59.9 | 71.1 | 65.9 | |
| ATTNFeature Category=Pre-gen. features, Head=Lin.2026.07 | 66.8 | 65.5 | 65.8 | 68.4 | 66.6 | |
| LAST8Feature Category=Pre-gen. features, Head=Tr.2026.07 | 66.6 | 64.9 | 61.2 | 70.1 | 65.7 | |
| EOPFeature Category=Pre-gen. features, Head=Lin.2026.07 | 62 | 60.3 | 61.6 | 62.5 | 61.6 | |
| TOKPROBFeature Category=Post-gen. and UQ, Head=Lin.2026.07 | 60.2 | 62.2 | 57.1 | 56.7 | 59.1 | |
| OUTSEQFeature Category=Post-gen. and UQ, Head=Tr.2026.07 | 57.5 | 60.7 | 55.7 | 55.1 | 57.2 | |
| OUTSEQFeature Category=Post-gen. and UQ, Head=Lin.2026.07 | 56.2 | 59.4 | 54.2 | 53.7 | 55.9 | |
| ORACLE-UQFeature Category=Post-gen. and UQ2026.07 | 55.9 | 51.5 | 48.7 | 53.5 | 52.4 | |
| MSPFeature Category=Post-gen. and UQ2026.07 | 55 | 48.8 | 47 | 41 | 47.9 | |
| LAST8Feature Category=Pre-gen. features, Head=Tr.2026.07 | 53.4 | 50.8 | 57.2 | 52.7 | 53.5 | |
| LAST8Feature Category=Pre-gen. features, Head=Lin.2026.07 | 52.1 | 49.8 | 55.7 | 51.4 | 52.3 | |
| OUTSEQFeature Category=Post-gen. and UQ, Head=Tr.2026.07 | 51.8 | 49.9 | 54.4 | 50.6 | 51.7 | |
| TOKPROBFeature Category=Post-gen. and UQ, Head=Lin.2026.07 | 50.5 | 48.7 | 53 | 49.2 | 50.4 | |
| RandomFeature Category=Post-gen. and UQ2026.07 | 49.7 | 49.8 | 50 | 49.8 | 49.8 | |
| OUTSEQFeature Category=Post-gen. and UQ, Head=Lin.2026.07 | 49.6 | 47.8 | 52 | 48.3 | 49.4 | |
| ATTN+LAST8Feature Category=Pre-gen. features, Head=Lin.2026.07 | 48.6 | 48 | 52.4 | 47.2 | 49 | |
| EOPFeature Category=Pre-gen. features, Head=Lin.2026.07 | 47.3 | 45.2 | 50.3 | 46.9 | 47.4 | |
| ATTNFeature Category=Pre-gen. features, Head=Lin.2026.07 | 43.9 | 44.6 | 48.2 | 42.9 | 44.9 | |
| MSPFeature Category=Post-gen. and UQ2026.07 | 37.3 | 36.4 | 30 | 29 | 33.2 | |
| ORACLE-UQFeature Category=Post-gen. and UQ2026.07 | 37.3 | 36.8 | 30.4 | 31.6 | 34 | |
| VISFeature Category=Pre-gen. features, Head=Lin.2026.07 | 33.9 | 32.6 | 31.2 | 35.3 | 33.2 | |
| RandomFeature Category=Post-gen. and UQ2026.07 | 32.6 | 34.1 | 30.2 | 28.7 | 31.4 |