# Zero-shot Classification on ImageNet zero-shot 1k

Source: [Zero-shot Classification on ImageNet zero-shot 1k](<https://www.sota2.com/research/sota/zero-shot-classification-on-imagenet-zero-shot-1k>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T09:58:13.597Z

Evaluation of Zero-shot Classification performance on the ImageNet zero-shot 1k dataset configuration, measured by IN1k Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Zero-shot Classification |
| Dataset (including any stated split) | ImageNet zero-shot 1k |
| Metric | IN1k Accuracy (Zero-shot) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 12 of 12 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [IN1k Accuracy (Zero-shot)](<https://www.sota2.com/research/sota/zero-shot-classification-on-imagenet-zero-shot-1k.md?metric=IN1k%20Accuracy%20(Zero-shot)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | IN1k Accuracy (Zero-shot) | Result date | Report paper |
| --- | --- | --- | --- |
| CLIPScore | 5.1 | Not recorded | 68fa79af1e209131cea7edfc |
| DKLR | 3.25 | Not recorded | 68fa79af1e209131cea7edfc |
| DC | 3.12 | Not recorded | 68fa79af1e209131cea7edfc |
| LAION2B | 3.1 | Not recorded | 68fa79af1e209131cea7edfc |
| Basic | 3 | Not recorded | 68fa79af1e209131cea7edfc |
| DKL | 3 | Not recorded | 68fa79af1e209131cea7edfc |
| No filtering | 2.5 | Not recorded | 68fa79af1e209131cea7edfc |
| DKL | 2.16 | Not recorded | 68fa79af1e209131cea7edfc |
| DW | 2.15 | Not recorded | 68fa79af1e209131cea7edfc |
| DKLR | 1.76 | Not recorded | 68fa79af1e209131cea7edfc |
| DW | 1.44 | Not recorded | 68fa79af1e209131cea7edfc |
| DC | 1.08 | Not recorded | 68fa79af1e209131cea7edfc |

### CLIPScore

IN1k Accuracy (Zero-shot): 5.1. Result ID: 6a1ea91ffbc373592c194f13.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e81e209131cea4de2f.md>)

[Implementation](<https://www.sota2.com/www.datacomp.ai>)

Recorded evaluation configuration: {"Modal":"N/A"}. This record does not assert independent reproduction.

### DKLR

IN1k Accuracy (Zero-shot): 3.25. Result ID: 6a1ea91ffbc373592c194f16.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

Recorded evaluation configuration: {"Modal":"Text"}. This record does not assert independent reproduction.

### DC

IN1k Accuracy (Zero-shot): 3.12. Result ID: 6a1ea91ffbc373592c194f1a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

Recorded evaluation configuration: {"Modal":"Text"}. This record does not assert independent reproduction.

### LAION2B

IN1k Accuracy (Zero-shot): 3.1. Result ID: 6a1ea91ffbc373592c194f11.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e81e209131cea4de2f.md>)

[Implementation](<https://www.sota2.com/www.datacomp.ai>)

Recorded evaluation configuration: {"Modal":"N/A"}. This record does not assert independent reproduction.

### Basic

IN1k Accuracy (Zero-shot): 3. Result ID: 6a1ea91ffbc373592c194f12.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e81e209131cea4de2f.md>)

[Implementation](<https://www.sota2.com/www.datacomp.ai>)

Recorded evaluation configuration: {"Modal":"N/A"}. This record does not assert independent reproduction.

### DKL

IN1k Accuracy (Zero-shot): 3. Result ID: 6a1ea91ffbc373592c194f14.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

Recorded evaluation configuration: {"Modal":"Text"}. This record does not assert independent reproduction.

### No filtering

IN1k Accuracy (Zero-shot): 2.5. Result ID: 6a1ea91ffbc373592c194f10.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70e81e209131cea4de2f.md>)

[Implementation](<https://www.sota2.com/www.datacomp.ai>)

Recorded evaluation configuration: {"Modal":"N/A"}. This record does not assert independent reproduction.

### DKL

IN1k Accuracy (Zero-shot): 2.16. Result ID: 6a1ea91ffbc373592c194f15.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

Recorded evaluation configuration: {"Modal":"Image"}. This record does not assert independent reproduction.

### DW

IN1k Accuracy (Zero-shot): 2.15. Result ID: 6a1ea91ffbc373592c194f18.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

Recorded evaluation configuration: {"Modal":"Text"}. This record does not assert independent reproduction.

### DKLR

IN1k Accuracy (Zero-shot): 1.76. Result ID: 6a1ea91ffbc373592c194f17.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

Recorded evaluation configuration: {"Modal":"Image"}. This record does not assert independent reproduction.

### DW

IN1k Accuracy (Zero-shot): 1.44. Result ID: 6a1ea91ffbc373592c194f19.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

Recorded evaluation configuration: {"Modal":"Image"}. This record does not assert independent reproduction.

### DC

IN1k Accuracy (Zero-shot): 1.08. Result ID: 6a1ea91ffbc373592c194f1b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edfc.md>)

Recorded evaluation configuration: {"Modal":"Image"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
