# Integrating Propositional and Relational Label Side Information for Hierarchical Zero-Shot Image Classification

Source: [Integrating Propositional and Relational Label Side Information for Hierarchical Zero-Shot Image Classification](<https://www.sota2.com/research/paper/68fa65681e209131cea0a1d5>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:26:52.925Z

Authors: Colin Samplawski, Heesung Kwon, Erik Learned-Miller, Benjamin M. Marlin

Published: 2019-02-14T16:54:19.000Z

## Abstract

Zero-shot learning (ZSL) is one of the most extreme forms of learning from scarce labeled data. It enables predicting that images belong to classes for which no labeled training instances are available. In this paper, we present a new ZSL framework that leverages both label attribute side information and a semantic label hierarchy. We present two methods, lifted zero-shot prediction and a custom conditional random field (CRF) model, that integrate both forms of side information. We propose benchmark tasks for this framework that focus on making predictions across a range of semantic levels. We show that lifted zero-shot prediction can dramatically outperform baseline methods when making predictions within specified semantic levels, and that the probability distribution provided by the CRF model can be leveraged to yield further performance improvements when making unconstrained predictions over the hierarchy.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1902.05492>)

[PDF](<https://arxiv.org/pdf/1902.05492.pdf>)
