# Image Classification on ELEVATER and ImageNet 21 multimodal datasets (test)

Source: [Image Classification on ELEVATER and ImageNet 21 multimodal datasets (test)](<https://www.sota2.com/research/sota/image-classification-on-elevater-and-imagenet-21-multimodal-datasets-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:29:10.952Z

Evaluation of Image Classification performance across the combined test sets of the ELEVATER suite and the ImageNet 21K multimodal datasets.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Classification |
| Dataset (including any stated split) | ELEVATER and ImageNet 21 multimodal datasets (test) |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 5 of 5 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/image-classification-on-elevater-and-imagenet-21-multimodal-datasets-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| NegCLIP | 56.8 | Not recorded | 68fa70f11e209131cea4e388 |
| MosaiCLIP WiSE-FT | 56.8 | Not recorded | 68fa70f11e209131cea4e388 |
| CLIP | 56.4 | Not recorded | 68fa70f11e209131cea4e388 |
| MosaiCLIP NoCurric | 55.8 | Not recorded | 68fa70f11e209131cea4e388 |
| MosaiCLIP | 55.7 | Not recorded | 68fa70f11e209131cea4e388 |

### NegCLIP

Accuracy: 56.8. Result ID: 699166c83a6c31484907e5a3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70f11e209131cea4e388.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee31e209131cea42a7d.md>)

Recorded evaluation configuration: {"Zero-shot":true,"Aggregation":"Average of 21 datasets"}. This record does not assert independent reproduction.

### MosaiCLIP WiSE-FT

Accuracy: 56.8. Result ID: 699166c83a6c31484907e5a5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70f11e209131cea4e388.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f11e209131cea4e388.md>)

Recorded evaluation configuration: {"Zero-shot":true,"Aggregation":"Average of 21 datasets","Weight-Space Ensembled":true}. This record does not assert independent reproduction.

### CLIP

Accuracy: 56.4. Result ID: 699166c83a6c31484907e5a2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70f11e209131cea4e388.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Zero-shot":true,"Aggregation":"Average of 21 datasets"}. This record does not assert independent reproduction.

### MosaiCLIP NoCurric

Accuracy: 55.8. Result ID: 699166c83a6c31484907e5a4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70f11e209131cea4e388.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f11e209131cea4e388.md>)

Recorded evaluation configuration: {"Zero-shot":true,"Aggregation":"Average of 21 datasets","Curriculum Learning":false}. This record does not assert independent reproduction.

### MosaiCLIP

Accuracy: 55.7. Result ID: 699166c83a6c31484907e5a6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70f11e209131cea4e388.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f11e209131cea4e388.md>)

Recorded evaluation configuration: {"Zero-shot":true,"Aggregation":"Average of 21 datasets"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
