# Compositional Zero-Shot Learning on UT-Zappos open-vocabulary partition

Source: [Compositional Zero-Shot Learning on UT-Zappos open-vocabulary partition](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-ut-zappos-open-vocabulary-partition>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-05T08:50:26.147Z

Evaluation of Compositional Zero-Shot Learning performance on the open-vocabulary partition of the UT-Zappos dataset, reporting Harmonic Mean (HM), AUC, and various Attribute/Object decomposition scores (AO, A\*O, etc.).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Compositional Zero-Shot Learning |
| Dataset (including any stated split) | UT-Zappos open-vocabulary partition |
| Metric | HM (Harmonic Mean) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [HM (Harmonic Mean)](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-ut-zappos-open-vocabulary-partition.md?metric=HM%20(Harmonic%20Mean)>): Higher is better; unit: PERCENT.

- [AUC](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-ut-zappos-open-vocabulary-partition.md?metric=AUC>): Higher is better; unit: PERCENT.

- [AO (Attribute Only)](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-ut-zappos-open-vocabulary-partition.md?metric=AO%20(Attribute%20Only)>): Higher is better; unit: PERCENT.

- [AO\* (Attribute Only variant)](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-ut-zappos-open-vocabulary-partition.md?metric=AO*%20(Attribute%20Only%20variant)>): Higher is better; unit: PERCENT.

- [A\*O (Attribute/Object decomposition)](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-ut-zappos-open-vocabulary-partition.md?metric=A*O%20(Attribute%2FObject%20decomposition)>): Higher is better; unit: PERCENT.

- [AO\* (Attribute Only variant 2)](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-ut-zappos-open-vocabulary-partition.md?metric=AO*%20(Attribute%20Only%20variant%202)>): Higher is better; unit: PERCENT.

- [A\*O\* (Attribute/Object decomposition variant)](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-ut-zappos-open-vocabulary-partition.md?metric=A*O*%20(Attribute%2FObject%20decomposition%20variant)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | HM (Harmonic Mean) | Result date | Report paper |
| --- | --- | --- | --- |
| DFSP + SPA | 34.32 | Not recorded | 69a90e112d603e6de3e40846 |
| Troika + SPA | 32.98 | Not recorded | 69a90e112d603e6de3e40846 |
| DFSP | 32.07 | Not recorded | 69a90e112d603e6de3e40846 |
| +SPA Avg | 31.61 | Not recorded | 69a90e112d603e6de3e40846 |
| Troika | 31.13 | Not recorded | 69a90e112d603e6de3e40846 |
| HPL + SPA | 30.13 | Not recorded | 69a90e112d603e6de3e40846 |
| Baseline Avg | 29.59 | Not recorded | 69a90e112d603e6de3e40846 |
| CSP + SPA | 29.01 | Not recorded | 69a90e112d603e6de3e40846 |
| HPL | 27.83 | Not recorded | 69a90e112d603e6de3e40846 |
| CSP | 27.33 | Not recorded | 69a90e112d603e6de3e40846 |

### DFSP + SPA

HM (Harmonic Mean): 34.32. Result ID: 69a943be6dbb7075b952d273.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting","SPA":"True"}. This record does not assert independent reproduction.

### Troika + SPA

HM (Harmonic Mean): 32.98. Result ID: 69a943be6dbb7075b952d275.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting","SPA":"True"}. This record does not assert independent reproduction.

### DFSP

HM (Harmonic Mean): 32.07. Result ID: 69a943be6dbb7075b952d272.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d0c9.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting","SPA":"False"}. This record does not assert independent reproduction.

### +SPA Avg

HM (Harmonic Mean): 31.61. Result ID: 69a943be6dbb7075b952d277.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"SPA":"True"}. This record does not assert independent reproduction.

### Troika

HM (Harmonic Mean): 31.13. Result ID: 69a943be6dbb7075b952d274.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ad1e209131cea57c90.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting","SPA":"False"}. This record does not assert independent reproduction.

### HPL + SPA

HM (Harmonic Mean): 30.13. Result ID: 69a943be6dbb7075b952d271.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting","SPA":"True"}. This record does not assert independent reproduction.

### Baseline Avg

HM (Harmonic Mean): 29.59. Result ID: 69a943be6dbb7075b952d276.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"SPA":"False"}. This record does not assert independent reproduction.

### CSP + SPA

HM (Harmonic Mean): 29.01. Result ID: 69a943be6dbb7075b952d26f.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting","SPA":"True"}. This record does not assert independent reproduction.

### HPL

HM (Harmonic Mean): 27.83. Result ID: 69a943be6dbb7075b952d270.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting","SPA":"False"}. This record does not assert independent reproduction.

### CSP

HM (Harmonic Mean): 27.33. Result ID: 69a943be6dbb7075b952d26e.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f291e209131cea44272.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting","SPA":"False"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
