# Image Classification on Mean of 7 transfer datasets (test)

Source: [Image Classification on Mean of 7 transfer datasets (test)](<https://www.sota2.com/research/sota/image-classification-on-mean-of-7-transfer-datasets-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:33:59.865Z

Average performance of Image Classification models evaluated across a collection of 7 transfer datasets using the test split, reported across various few-shot settings (1-shot, 5-shot, 10-shot, 25-shot).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Classification |
| Dataset (including any stated split) | Mean of 7 transfer datasets (test) |
| Metric | Accuracy (1-shot) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 3 of 3 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy (1-shot)](<https://www.sota2.com/research/sota/image-classification-on-mean-of-7-transfer-datasets-test.md?metric=Accuracy%20(1-shot)>): Higher is better; unit: PERCENT.

- [Accuracy (5-shot)](<https://www.sota2.com/research/sota/image-classification-on-mean-of-7-transfer-datasets-test.md?metric=Accuracy%20(5-shot)>): Higher is better; unit: PERCENT.

- [Accuracy (10-shot)](<https://www.sota2.com/research/sota/image-classification-on-mean-of-7-transfer-datasets-test.md?metric=Accuracy%20(10-shot)>): Higher is better; unit: PERCENT.

- [Accuracy (25-shot)](<https://www.sota2.com/research/sota/image-classification-on-mean-of-7-transfer-datasets-test.md?metric=Accuracy%20(25-shot)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy (1-shot) | Result date | Report paper |
| --- | --- | --- | --- |
| MAP^wd + FroFA | 0.554 | Not recorded | 68fa74411e209131cea608c8 |
| MAP^wd | 0.51 | Not recorded | 68fa74411e209131cea608c8 |
| Linear probe | 0.491 | Not recorded | 68fa74411e209131cea608c8 |

### MAP^wd + FroFA

Accuracy (1-shot): 0.554. Result ID: 699344023a6c31484914cf1d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608c8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608c8.md>)

[Implementation](<https://frozen-feature-augmentation.github.io/>)

Recorded evaluation configuration: {"Backbone":"JFT-3B L/16","training\_mode":"weight-decayed MAP with brightness c2FroFA"}. This record does not assert independent reproduction.

### MAP^wd

Accuracy (1-shot): 0.51. Result ID: 699344023a6c31484914cf1b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608c8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4e7.md>)

Recorded evaluation configuration: {"Backbone":"JFT-3B L/16","training\_mode":"weight-decayed MAP"}. This record does not assert independent reproduction.

### Linear probe

Accuracy (1-shot): 0.491. Result ID: 699344023a6c31484914cf1c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74411e209131cea608c8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Backbone":"JFT-3B L/16","training\_mode":"L2-regularized linear probe"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
