Unknown entity vs. Visual evidence failure Classification on PopVQA and iNaturalist Attribution Tree benchmark leaderboard · SOTA2 Research

Unknown entity vs. Visual evidence failure Classification on PopVQA and iNaturalist Attribution Tree

98.4GemmaVIS

Evaluation Results

Method	Links
VIS2026.07		98.4	99.7	90.7	99.3	97
ATTN+LAST82026.07		68.4	67	62.6	72.3	67.6
LAST82026.07		67.2	65.5	59.9	71.1	65.9
ATTN2026.07		66.8	65.5	65.8	68.4	66.6
LAST82026.07		66.6	64.9	61.2	70.1	65.7
EOP2026.07		62	60.3	61.6	62.5	61.6
TOKPROB2026.07		60.2	62.2	57.1	56.7	59.1
OUTSEQ2026.07		57.5	60.7	55.7	55.1	57.2
OUTSEQ2026.07		56.2	59.4	54.2	53.7	55.9
ORACLE-UQ2026.07		55.9	51.5	48.7	53.5	52.4
MSP2026.07		55	48.8	47	41	47.9
LAST82026.07		53.4	50.8	57.2	52.7	53.5
LAST82026.07		52.1	49.8	55.7	51.4	52.3
OUTSEQ2026.07		51.8	49.9	54.4	50.6	51.7
TOKPROB2026.07		50.5	48.7	53	49.2	50.4
Random2026.07		49.7	49.8	50	49.8	49.8
OUTSEQ2026.07		49.6	47.8	52	48.3	49.4
ATTN+LAST82026.07		48.6	48	52.4	47.2	49
EOP2026.07		47.3	45.2	50.3	46.9	47.4
ATTN2026.07		43.9	44.6	48.2	42.9	44.9
MSP2026.07		37.3	36.4	30	29	33.2
ORACLE-UQ2026.07		37.3	36.8	30.4	31.6	34
VIS2026.07		33.9	32.6	31.2	35.3	33.2
Random2026.07		32.6	34.1	30.2	28.7	31.4