# Zero-Shot Classification on SUN (T1, U, S, H metrics)

Source: [Zero-Shot Classification on SUN (T1, U, S, H metrics)](<https://www.sota2.com/research/sota/zero-shot-classification-on-sun-t1-u-s-h-metrics>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-07T07:24:11.029Z

Evaluation of Zero-Shot Classification performance on the SUN dataset, reporting T1, U, S, and H metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Zero-Shot Classification |
| Dataset (including any stated split) | SUN |
| Metric | U Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 34 of 34 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [U Score](<https://www.sota2.com/research/sota/zero-shot-classification-on-sun-t1-u-s-h-metrics.md?metric=U%20Score>): Higher is better; unit: PERCENT.

- [T1 Accuracy](<https://www.sota2.com/research/sota/zero-shot-classification-on-sun-t1-u-s-h-metrics.md?metric=T1%20Accuracy>): Higher is better; unit: PERCENT.

- [S Score](<https://www.sota2.com/research/sota/zero-shot-classification-on-sun-t1-u-s-h-metrics.md?metric=S%20Score>): Higher is better; unit: PERCENT.

- [H Score](<https://www.sota2.com/research/sota/zero-shot-classification-on-sun-t1-u-s-h-metrics.md?metric=H%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | U Score | Result date | Report paper |
| --- | --- | --- | --- |
| CV-DCLR | 62 | Not recorded | 6a4c87f385dba69fef8b249e |
| CV-DCLR | 61.9 | Not recorded | 6a4c87f385dba69fef8b249e |
| ACR | 60 | Not recorded | 6940e761456146936284f52f |
| VSPCN | 59.4 | Not recorded | 6940e761456146936284f52f |
| CV-DCLR | 58.3 | Not recorded | 6a4c87f385dba69fef8b249e |
| SVIP | 53.7 | Not recorded | 6940e761456146936284f52f |
| CV-DCLR | 53.3 | Not recorded | 6a4c87f385dba69fef8b249e |
| MSDN | 52.2 | Not recorded | 6940e761456146936284f52f |
| MSDN | 50.1 | Not recorded | 6a4c87f385dba69fef8b249e |
| MSDN | 48.9 | Not recorded | 6a4c87f385dba69fef8b249e |
| TransZero | 48.7 | Not recorded | 6a4c87f385dba69fef8b249e |
| HSVA | 48.6 | Not recorded | 6940e761456146936284f52f |
| TransZero | 48.5 | Not recorded | 6a4c87f385dba69fef8b249e |
| SDGZSL | 48.2 | Not recorded | 6940e761456146936284f52f |
| TransZero | 47.4 | Not recorded | 6a4c87f385dba69fef8b249e |
| TransZero | 46.9 | Not recorded | 6a4c87f385dba69fef8b249e |
| ZSLViT | 45.9 | Not recorded | 6940e761456146936284f52f |
| MSDN | 45.8 | Not recorded | 6a4c87f385dba69fef8b249e |
| RFF | 45.7 | Not recorded | 6940e761456146936284f52f |
| DUET | 45.7 | Not recorded | 6940e761456146936284f52f |
| TF | 45.6 | Not recorded | 6940e761456146936284f52f |
| ICIS | 45.2 | Not recorded | 6940e761456146936284f52f |
| CoAR-ZSL | 43.5 | Not recorded | 6a4c87f385dba69fef8b249e |
| CoAR-ZSL | 42.6 | Not recorded | 6a4c87f385dba69fef8b249e |
| APN | 41.9 | Not recorded | 6940e761456146936284f52f |
| GEM-ZSL | 38.4 | Not recorded | 6a4c87f385dba69fef8b249e |
| GEM | 38.1 | Not recorded | 6940e761456146936284f52f |
| CoAR-ZSL | 37.7 | Not recorded | 6a4c87f385dba69fef8b249e |
| GEM-ZSL | 37.4 | Not recorded | 6a4c87f385dba69fef8b249e |
| Dis-VAE | 36.6 | Not recorded | 6940e761456146936284f52f |
| MSDN | 35.5 | Not recorded | 6a4c87f385dba69fef8b249e |
| CoAR-ZSL | 35.4 | Not recorded | 6a4c87f385dba69fef8b249e |
| GEM-ZSL | 31.8 | Not recorded | 6a4c87f385dba69fef8b249e |
| GEM-ZSL | 30.2 | Not recorded | 6a4c87f385dba69fef8b249e |

### CV-DCLR

U Score: 62. Result ID: 6a4ca97d60b88bb339c777df.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"4"}. This record does not assert independent reproduction.

### CV-DCLR

U Score: 61.9. Result ID: 6a4ca97d60b88bb339c777de.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"3"}. This record does not assert independent reproduction.

### ACR

U Score: 60. Result ID: 699851105698665ec4aeb1f4.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

Recorded evaluation configuration: {"Backbone":"ViT-based"}. This record does not assert independent reproduction.

### VSPCN

U Score: 59.4. Result ID: 699851105698665ec4aeb1f2.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77bf1e209131cea75122.md>)

Recorded evaluation configuration: {"Backbone":"ViT-based","Venue":"CVPR’25"}. This record does not assert independent reproduction.

### CV-DCLR

U Score: 58.3. Result ID: 6a4ca97d60b88bb339c777dd.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"2"}. This record does not assert independent reproduction.

### SVIP

U Score: 53.7. Result ID: 699851105698665ec4aeb1f3.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79ec1e209131cea7ffd3.md>)

Recorded evaluation configuration: {"Backbone":"ViT-based","Venue":"ICCV’25"}. This record does not assert independent reproduction.

### CV-DCLR

U Score: 53.3. Result ID: 6a4ca97d60b88bb339c777dc.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"1"}. This record does not assert independent reproduction.

### MSDN

U Score: 52.2. Result ID: 699851105698665ec4aeb1ee.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c571e209131cea33648.md>)

Recorded evaluation configuration: {"Backbone":"ResNet101","Venue":"CVPR’22"}. This record does not assert independent reproduction.

### MSDN

U Score: 50.1. Result ID: 6a4ca97d60b88bb339c777d0.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c571e209131cea33648.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"1"}. This record does not assert independent reproduction.

### MSDN

U Score: 48.9. Result ID: 6a4ca97d60b88bb339c777d1.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c571e209131cea33648.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"2"}. This record does not assert independent reproduction.

### TransZero

U Score: 48.7. Result ID: 6a4ca97d60b88bb339c777cd.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b631e209131cea2dfa0.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"2"}. This record does not assert independent reproduction.

### HSVA

U Score: 48.6. Result ID: 699851105698665ec4aeb1ed.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6afa1e209131cea2b786.md>)

[Implementation](<https://github.com/shiming-chen/HSVA>)

Recorded evaluation configuration: {"Backbone":"ResNet101","Venue":"NeurIPS’21"}. This record does not assert independent reproduction.

### TransZero

U Score: 48.5. Result ID: 6a4ca97d60b88bb339c777ce.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b631e209131cea2dfa0.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"3"}. This record does not assert independent reproduction.

### SDGZSL

U Score: 48.2. Result ID: 699851105698665ec4aeb1ea.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6aac1e209131cea29a2f.md>)

Recorded evaluation configuration: {"Backbone":"ResNet101","Venue":"ICCV’21"}. This record does not assert independent reproduction.

### TransZero

U Score: 47.4. Result ID: 6a4ca97d60b88bb339c777cc.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b631e209131cea2dfa0.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"1"}. This record does not assert independent reproduction.

### TransZero

U Score: 46.9. Result ID: 6a4ca97d60b88bb339c777cf.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b631e209131cea2dfa0.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"4"}. This record does not assert independent reproduction.

### ZSLViT

U Score: 45.9. Result ID: 699851105698665ec4aeb1f1.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74361e209131cea6077c.md>)

[Implementation](<https://github.com/shiming-chen/ZSLViT>)

Recorded evaluation configuration: {"Backbone":"ViT-based","Venue":"CVPR’24"}. This record does not assert independent reproduction.

### MSDN

U Score: 45.8. Result ID: 6a4ca97d60b88bb339c777d2.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c571e209131cea33648.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"3"}. This record does not assert independent reproduction.

### RFF

U Score: 45.7. Result ID: 699851105698665ec4aeb1e8.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a071e209131cea258f7.md>)

Recorded evaluation configuration: {"Backbone":"ResNet101","Venue":"CVPR’20"}. This record does not assert independent reproduction.

### DUET

U Score: 45.7. Result ID: 699851105698665ec4aeb1f0.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e8c1e209131cea407f4.md>)

[Implementation](<https://www.sota2.com/github.com/zjukg/DUET>)

Recorded evaluation configuration: {"Backbone":"ViT-based","Venue":"AAAI’23"}. This record does not assert independent reproduction.

### TF

U Score: 45.6. Result ID: 699851105698665ec4aeb1e7.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67f91e209131cea198e3.md>)

[Implementation](<https://github.com/akshitac8/tfvaegan>)

Recorded evaluation configuration: {"Backbone":"ResNet101","Venue":"ECCV’20"}. This record does not assert independent reproduction.

### ICIS

U Score: 45.2. Result ID: 699851105698665ec4aeb1ef.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70611e209131cea4ac44.md>)

Recorded evaluation configuration: {"Backbone":"ResNet101","Venue":"ICCV’23"}. This record does not assert independent reproduction.

### CoAR-ZSL

U Score: 43.5. Result ID: 6a4ca97d60b88bb339c777d8.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"1"}. This record does not assert independent reproduction.

### CoAR-ZSL

U Score: 42.6. Result ID: 6a4ca97d60b88bb339c777d9.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"2"}. This record does not assert independent reproduction.

### APN

U Score: 41.9. Result ID: 699851105698665ec4aeb1e9.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69eb1e209131cea24ee0.md>)

Recorded evaluation configuration: {"Backbone":"ResNet101","Venue":"NeurIPS’20"}. This record does not assert independent reproduction.

### GEM-ZSL

U Score: 38.4. Result ID: 6a4ca97d60b88bb339c777d4.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"1"}. This record does not assert independent reproduction.

### GEM

U Score: 38.1. Result ID: 699851105698665ec4aeb1ec.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa696d1e209131cea21f65.md>)

Recorded evaluation configuration: {"Backbone":"ResNet101","Venue":"CVPR’21"}. This record does not assert independent reproduction.

### CoAR-ZSL

U Score: 37.7. Result ID: 6a4ca97d60b88bb339c777da.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"3"}. This record does not assert independent reproduction.

### GEM-ZSL

U Score: 37.4. Result ID: 6a4ca97d60b88bb339c777d5.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"2"}. This record does not assert independent reproduction.

### Dis-VAE

U Score: 36.6. Result ID: 699851105698665ec4aeb1eb.

[Reporting paper](<https://www.sota2.com/research/paper/6940e761456146936284f52f.md>)

Recorded evaluation configuration: {"Backbone":"ResNet101","Venue":"AAAI’21"}. This record does not assert independent reproduction.

### MSDN

U Score: 35.5. Result ID: 6a4ca97d60b88bb339c777d3.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c571e209131cea33648.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"4"}. This record does not assert independent reproduction.

### CoAR-ZSL

U Score: 35.4. Result ID: 6a4ca97d60b88bb339c777db.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"4"}. This record does not assert independent reproduction.

### GEM-ZSL

U Score: 31.8. Result ID: 6a4ca97d60b88bb339c777d6.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"3"}. This record does not assert independent reproduction.

### GEM-ZSL

U Score: 30.2. Result ID: 6a4ca97d60b88bb339c777d7.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c87f385dba69fef8b249e.md>)

Recorded evaluation configuration: {"Entanglement level (r)":"4"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
