# Zero-shot Image Classification on ImageNet (Novel Split)

Source: [Zero-shot Image Classification on ImageNet (Novel Split)](<https://www.sota2.com/research/sota/zero-shot-image-classification-on-imagenet-novel-split>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-07T08:36:17.218Z

Evaluation of Zero-shot Image Classification performance on the novel split of the ImageNet dataset, typically measured by Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Zero-shot Image Classification |
| Dataset (including any stated split) | ImageNet (Novel Split) |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 13 of 13 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/zero-shot-image-classification-on-imagenet-novel-split.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| ArGue | 72.06 | Not recorded | 69fc1cac5497b3b670c8861e |
| MMRL + SpecPL | 71.5 | Not recorded | 69fc1cac5497b3b670c8861e |
| MMRL | 71.3 | Not recorded | 69fc1cac5497b3b670c8861e |
| CoPrompt | 71.27 | Not recorded | 69fc1cac5497b3b670c8861e |
| PromptSRC | 70.73 | Not recorded | 69fc1cac5497b3b670c8861e |
| MaPLe | 70.54 | Not recorded | 69fc1cac5497b3b670c8861e |
| CoCoOp | 70.43 | Not recorded | 69fc1cac5497b3b670c8861e |
| CoCoOp + SpecPL | 70.25 | Not recorded | 69fc1cac5497b3b670c8861e |
| DePT | 70.1 | Not recorded | 69fc1cac5497b3b670c8861e |
| CoOp + SpecPL | 70.01 | Not recorded | 69fc1cac5497b3b670c8861e |
| MaPLe + SpecPL | 69.37 | Not recorded | 69fc1cac5497b3b670c8861e |
| CLIP | 68.14 | Not recorded | 69fc1cac5497b3b670c8861e |
| CoOp | 67.88 | Not recorded | 69fc1cac5497b3b670c8861e |

### ArGue

Accuracy: 72.06. Result ID: 69fc4e0947f34ce924df03c5.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72821e209131cea56e20.md>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### MMRL + SpecPL

Accuracy: 71.5. Result ID: 69fc4e0947f34ce924df03cc.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### MMRL

Accuracy: 71.3. Result ID: 69fc4e0947f34ce924df03c8.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### CoPrompt

Accuracy: 71.27. Result ID: 69fc4e0947f34ce924df03c7.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### PromptSRC

Accuracy: 70.73. Result ID: 69fc4e0947f34ce924df03c4.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### MaPLe

Accuracy: 70.54. Result ID: 69fc4e0947f34ce924df03c3.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef21e209131cea4311c.md>)

[Implementation](<https://github.com/muzairkhattak/multimodal-prompt-learning>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### CoCoOp

Accuracy: 70.43. Result ID: 69fc4e0947f34ce924df03c2.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d8c1e209131cea3a831.md>)

[Implementation](<https://github.com/KaiyangZhou/CoOp>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### CoCoOp + SpecPL

Accuracy: 70.25. Result ID: 69fc4e0947f34ce924df03ca.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### DePT

Accuracy: 70.1. Result ID: 69fc4e0947f34ce924df03c6.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### CoOp + SpecPL

Accuracy: 70.01. Result ID: 69fc4e0947f34ce924df03c9.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### MaPLe + SpecPL

Accuracy: 69.37. Result ID: 69fc4e0947f34ce924df03cb.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### CLIP

Accuracy: 68.14. Result ID: 69fc4e0947f34ce924df03c0.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

### CoOp

Accuracy: 67.88. Result ID: 69fc4e0947f34ce924df03c1.

[Reporting paper](<https://www.sota2.com/research/paper/69fc1cac5497b3b670c8861e.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d8b1e209131cea3a814.md>)

[Implementation](<https://github.com/KaiyangZhou/CoOp>)

Recorded evaluation configuration: {"Shots":"16"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
