# Compositional Zero-Shot Learning on VAW CZSL (test)

Source: [Compositional Zero-Shot Learning on VAW CZSL (test)](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-05T08:50:26.254Z

Evaluation of Compositional Zero-Shot Learning performance on the test split of the VAW CZSL dataset, reporting metrics including V@3, V@5, HM, and component accuracies (Seen, Unseen, Attr., Obj.).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Compositional Zero-Shot Learning |
| Dataset (including any stated split) | VAW CZSL (test) |
| Metric | HM |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 30 of 30 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [HM](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=HM>): Higher is better; unit: PERCENT.

- [V@3](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=V%403>): Higher is better; unit: PERCENT.

- [V@5](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=V%405>): Higher is better; unit: PERCENT.

- [Seen Acc.](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=Seen%20Acc.>): Higher is better; unit: PERCENT.

- [Unseen Acc.](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=Unseen%20Acc.>): Higher is better; unit: PERCENT.

- [Attr. Acc.](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=Attr.%20Acc.>): Higher is better; unit: PERCENT.

- [Obj. Acc.](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=Obj.%20Acc.>): Higher is better; unit: PERCENT.

- [AUC](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=AUC>): Higher is better; unit: PERCENT.

- [AO](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=AO>): Higher is better; unit: PERCENT.

- [AO\*](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=AO*>): Higher is better; unit: PERCENT.

- [A\*O](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=A*O>): Higher is better; unit: PERCENT.

- [A\*O\*](<https://www.sota2.com/research/sota/compositional-zero-shot-learning-on-vaw-czsl-test.md?metric=A*O*>): Higher is better; unit: PERCENT.

## Recorded results

| Method | HM | Result date | Report paper |
| --- | --- | --- | --- |
| CAILA | 34.6 | Not recorded | 68fa711d1e209131cea4f2d4 |
| DFSP | 31.1 | Not recorded | 68fa711d1e209131cea4f2d4 |
| CSP | 23.3 | Not recorded | 68fa711d1e209131cea4f2d4 |
| DFSP+SPA | 21.91 | Not recorded | 69a90e112d603e6de3e40846 |
| DFSP | 20.87 | Not recorded | 69a90e112d603e6de3e40846 |
| Troika+SPA | 20.34 | Not recorded | 69a90e112d603e6de3e40846 |
| Troika | 18.25 | Not recorded | 69a90e112d603e6de3e40846 |
| Baseline Avg+SPA | 17.3 | Not recorded | 69a90e112d603e6de3e40846 |
| Baseline Avg | 16 | Not recorded | 69a90e112d603e6de3e40846 |
| OADis | 15.2 | Not recorded | 68fa6c9c1e209131cea34e1e |
| OADis | 15.2 | Not recorded | 68fa711d1e209131cea4f2d4 |
| CompCos | 14.2 | Not recorded | 68fa6c9c1e209131cea34e1e |
| CompCos | 14.2 | Not recorded | 68fa711d1e209131cea4f2d4 |
| CSP+SPA | 13.92 | Not recorded | 69a90e112d603e6de3e40846 |
| CSP | 13.26 | Not recorded | 69a90e112d603e6de3e40846 |
| HPL+SPA | 13.03 | Not recorded | 69a90e112d603e6de3e40846 |
| GraphEmb | 13 | Not recorded | 68fa6c9c1e209131cea34e1e |
| CGE | 13 | Not recorded | 68fa711d1e209131cea4f2d4 |
| Symnet | 12.2 | Not recorded | 68fa6c9c1e209131cea34e1e |
| TMN | 11.9 | Not recorded | 68fa6c9c1e209131cea34e1e |
| CLIP-ZS | 11.9 | Not recorded | 68fa711d1e209131cea4f2d4 |
| HPL | 11.6 | Not recorded | 69a90e112d603e6de3e40846 |
| OADis+NEL | 11.35 | Not recorded | 69a90e112d603e6de3e40846 |
| CANet | 11.21 | Not recorded | 69a90e112d603e6de3e40846 |
| OADis | 10.91 | Not recorded | 69a90e112d603e6de3e40846 |
| CompCos | 10.68 | Not recorded | 69a90e112d603e6de3e40846 |
| SCEN | 10.64 | Not recorded | 69a90e112d603e6de3e40846 |
| LabelEmbed+ | 9.8 | Not recorded | 68fa6c9c1e209131cea34e1e |
| AttrOpr | 9.1 | Not recorded | 68fa6c9c1e209131cea34e1e |
| LE | 8.27 | Not recorded | 69a90e112d603e6de3e40846 |

### CAILA

HM: 34.6. Result ID: 69a1590535dfcabb00e67314.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2d4.md>)

[Implementation](<https://www.sota2.com/github.com/zhaohengz/CAILA>)

Recorded evaluation configuration: {"CLIP usage":"With CLIP","Evaluation protocol":"Closed World"}. This record does not assert independent reproduction.

### DFSP

HM: 31.1. Result ID: 69a1590535dfcabb00e67313.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d0c9.md>)

Recorded evaluation configuration: {"CLIP usage":"With CLIP","Evaluation protocol":"Closed World"}. This record does not assert independent reproduction.

### CSP

HM: 23.3. Result ID: 69a1590535dfcabb00e67312.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f291e209131cea44272.md>)

Recorded evaluation configuration: {"CLIP usage":"With CLIP","Evaluation protocol":"Closed World"}. This record does not assert independent reproduction.

### DFSP+SPA

HM: 21.91. Result ID: 69a943be6dbb7075b952d283.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting Paradigm"}. This record does not assert independent reproduction.

### DFSP

HM: 20.87. Result ID: 69a943be6dbb7075b952d282.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6df81e209131cea3d0c9.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting Paradigm"}. This record does not assert independent reproduction.

### Troika+SPA

HM: 20.34. Result ID: 69a943be6dbb7075b952d285.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting Paradigm"}. This record does not assert independent reproduction.

### Troika

HM: 18.25. Result ID: 69a943be6dbb7075b952d284.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ad1e209131cea57c90.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting Paradigm"}. This record does not assert independent reproduction.

### Baseline Avg+SPA

HM: 17.3. Result ID: 69a943be6dbb7075b952d287.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting Paradigm"}. This record does not assert independent reproduction.

### Baseline Avg

HM: 16. Result ID: 69a943be6dbb7075b952d286.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting Paradigm"}. This record does not assert independent reproduction.

### OADis

HM: 15.2. Result ID: 698f25a63a6c314849f63084.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c9c1e209131cea34e1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c9c1e209131cea34e1e.md>)

[Implementation](<https://github.com/nirat1606/OADis>)

Recorded evaluation configuration: {"Backbone":"Frozen ResNet","Embeddings":"GloVe","Feature Pooling":"Convolutional"}. This record does not assert independent reproduction.

### OADis

HM: 15.2. Result ID: 69a1590535dfcabb00e6730f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c9c1e209131cea34e1e.md>)

[Implementation](<https://github.com/nirat1606/OADis>)

Recorded evaluation configuration: {"CLIP usage":"Without CLIP","Evaluation protocol":"Closed World"}. This record does not assert independent reproduction.

### CompCos

HM: 14.2. Result ID: 698f25a63a6c314849f63082.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c9c1e209131cea34e1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c371e209131cea32d6e.md>)

Recorded evaluation configuration: {"Backbone":"Frozen ResNet","Embeddings":"GloVe"}. This record does not assert independent reproduction.

### CompCos

HM: 14.2. Result ID: 69a1590535dfcabb00e6730e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69991e209131cea22f2b.md>)

Recorded evaluation configuration: {"CLIP usage":"Without CLIP","Evaluation protocol":"Closed World"}. This record does not assert independent reproduction.

### CSP+SPA

HM: 13.92. Result ID: 69a943be6dbb7075b952d27f.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting Paradigm"}. This record does not assert independent reproduction.

### CSP

HM: 13.26. Result ID: 69a943be6dbb7075b952d27e.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f291e209131cea44272.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting Paradigm"}. This record does not assert independent reproduction.

### HPL+SPA

HM: 13.03. Result ID: 69a943be6dbb7075b952d281.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting Paradigm"}. This record does not assert independent reproduction.

### GraphEmb

HM: 13. Result ID: 698f25a63a6c314849f63083.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c9c1e209131cea34e1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69e91e209131cea24d40.md>)

[Implementation](<https://github.com/ExplainableML/czsl>)

Recorded evaluation configuration: {"Backbone":"Frozen ResNet","Embeddings":"GloVe"}. This record does not assert independent reproduction.

### CGE

HM: 13. Result ID: 69a1590535dfcabb00e67310.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69e91e209131cea24d40.md>)

[Implementation](<https://github.com/ExplainableML/czsl>)

Recorded evaluation configuration: {"CLIP usage":"Without CLIP","Evaluation protocol":"Closed World"}. This record does not assert independent reproduction.

### Symnet

HM: 12.2. Result ID: 698f25a63a6c314849f63080.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c9c1e209131cea34e1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67561e209131cea159a9.md>)

[Implementation](<https://github.com/DirtyHarryLYL/SymNet>)

Recorded evaluation configuration: {"Backbone":"Frozen ResNet","Embeddings":"GloVe"}. This record does not assert independent reproduction.

### TMN

HM: 11.9. Result ID: 698f25a63a6c314849f63081.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c9c1e209131cea34e1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65bd1e209131cea0c0a8.md>)

Recorded evaluation configuration: {"Backbone":"Frozen ResNet","Embeddings":"GloVe"}. This record does not assert independent reproduction.

### CLIP-ZS

HM: 11.9. Result ID: 69a1590535dfcabb00e67311.

[Reporting paper](<https://www.sota2.com/research/paper/68fa711d1e209131cea4f2d4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"CLIP usage":"With CLIP","Evaluation protocol":"Closed World"}. This record does not assert independent reproduction.

### HPL

HM: 11.6. Result ID: 69a943be6dbb7075b952d280.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"VLM Prompting Paradigm"}. This record does not assert independent reproduction.

### OADis+NEL

HM: 11.35. Result ID: 69a943be6dbb7075b952d27d.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

Recorded evaluation configuration: {"Paradigm":"Traditional Paradigm (Non-VLM)"}. This record does not assert independent reproduction.

### CANet

HM: 11.21. Result ID: 69a943be6dbb7075b952d27c.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fb81e209131cea47034.md>)

[Implementation](<https://github.com/wqshmzh/CANet-CZSL>)

Recorded evaluation configuration: {"Paradigm":"Traditional Paradigm (Non-VLM)"}. This record does not assert independent reproduction.

### OADis

HM: 10.91. Result ID: 69a943be6dbb7075b952d27a.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c9c1e209131cea34e1e.md>)

[Implementation](<https://github.com/nirat1606/OADis>)

Recorded evaluation configuration: {"Paradigm":"Traditional Paradigm (Non-VLM)"}. This record does not assert independent reproduction.

### CompCos

HM: 10.68. Result ID: 69a943be6dbb7075b952d279.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69991e209131cea22f2b.md>)

Recorded evaluation configuration: {"Paradigm":"Traditional Paradigm (Non-VLM)"}. This record does not assert independent reproduction.

### SCEN

HM: 10.64. Result ID: 69a943be6dbb7075b952d27b.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ede1e209131cea42802.md>)

Recorded evaluation configuration: {"Paradigm":"Traditional Paradigm (Non-VLM)"}. This record does not assert independent reproduction.

### LabelEmbed+

HM: 9.8. Result ID: 698f25a63a6c314849f6307f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c9c1e209131cea34e1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64bc1e209131cea062a1.md>)

[Implementation](<https://www.sota2.com/github.com/attributes-as-operators>)

Recorded evaluation configuration: {"Backbone":"Frozen ResNet","Embeddings":"GloVe"}. This record does not assert independent reproduction.

### AttrOpr

HM: 9.1. Result ID: 698f25a63a6c314849f6307e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c9c1e209131cea34e1e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64bc1e209131cea062a1.md>)

[Implementation](<https://www.sota2.com/github.com/attributes-as-operators>)

Recorded evaluation configuration: {"Backbone":"Frozen ResNet","Embeddings":"GloVe"}. This record does not assert independent reproduction.

### LE

HM: 8.27. Result ID: 69a943be6dbb7075b952d278.

[Reporting paper](<https://www.sota2.com/research/paper/69a90e112d603e6de3e40846.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64bc1e209131cea062a1.md>)

[Implementation](<https://www.sota2.com/github.com/attributes-as-operators>)

Recorded evaluation configuration: {"Paradigm":"Traditional Paradigm (Non-VLM)"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.