# Image Classification on STL-10 (Standard Accuracy)

Source: [Image Classification on STL-10 (Standard Accuracy)](<https://www.sota2.com/research/sota/image-classification-on-stl-10-standard-accuracy>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-19T08:59:30.835Z

Evaluation of standard Image Classification performance on the STL-10 dataset, reporting general Top-1 Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Image Classification |
| Dataset (including any stated split) | STL-10 |
| Metric | Top-1 Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 28 of 28 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Top-1 Accuracy](<https://www.sota2.com/research/sota/image-classification-on-stl-10-standard-accuracy.md?metric=Top-1%20Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Top-1 Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| StarFT | 99 | Not recorded | 6a0a9d2cdbc836b87d82b4d7 |
| CaRot | 98.7 | Not recorded | 6a0a9d2cdbc836b87d82b4d7 |
| SAE-FT | 98.7 | Not recorded | 6a0a9d2cdbc836b87d82b4d7 |
| FLYP | 98.5 | Not recorded | 6a0a9d2cdbc836b87d82b4d7 |
| Zero-shot | 98.3 | Not recorded | 6a0a9d2cdbc836b87d82b4d7 |
| WiSE-FT | 98.1 | Not recorded | 6a0a9d2cdbc836b87d82b4d7 |
| Simple Averaging | 97.2 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| WUDI-Merging w/ E-PMQ | 96.88 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| CAR-FT | 96.7 | Not recorded | 6a0a9d2cdbc836b87d82b4d7 |
| Simple Averaging w/ GPTQ | 96.63 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| Simple Averaging w/ RTN | 96.45 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| WUDI-Merging | 96.1 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| Simple Averaging w/ AWQ | 96.05 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| WUDI-Merging w/ GPTQ | 95.66 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| FT | 95.3 | Not recorded | 6a0a9d2cdbc836b87d82b4d7 |
| Simple Averaging w/ E-PMQ | 95.1 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| WUDI-Merging w/ AWQ | 94.95 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| TIES-Merging | 94.8 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| WUDI-Merging w/ RTN | 94.7 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| TIES-Merging w/ E-PMQ | 94.59 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| TIES-Merging w/ GPTQ | 94.45 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| Task Arithmetic w/ E-PMQ | 94.25 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| TIES-Merging w/ RTN | 93.88 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| TIES-Merging w/ AWQ | 93.45 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| Task Arithmetic | 84.6 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| Task Arithmetic w/ GPTQ | 83.58 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| Task Arithmetic w/ AWQ | 83.55 | Not recorded | 6a0beeb5dbc836b87d82c544 |
| Task Arithmetic w/ RTN | 82.76 | Not recorded | 6a0beeb5dbc836b87d82c544 |

### StarFT

Top-1 Accuracy: 99. Result ID: 6a0ad28e47f34ce924f11772.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d2cdbc836b87d82b4d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edf0.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### CaRot

Top-1 Accuracy: 98.7. Result ID: 6a0ad28e47f34ce924f11770.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d2cdbc836b87d82b4d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa759b1e209131cea68ef2.md>)

[Implementation](<https://anonymous.4open.science/r/CaRot-5C50>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### SAE-FT

Top-1 Accuracy: 98.7. Result ID: 6a0ad28e47f34ce924f11773.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d2cdbc836b87d82b4d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0a9d2cdbc836b87d82b4d7.md>)

[Implementation](<https://github.com/Fabian-Mor/sae-ft>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### FLYP

Top-1 Accuracy: 98.5. Result ID: 6a0ad28e47f34ce924f1176e.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d2cdbc836b87d82b4d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e241e209131cea3e1b0.md>)

[Implementation](<https://github.com/locuslab/FLYP>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### Zero-shot

Top-1 Accuracy: 98.3. Result ID: 6a0ad28e47f34ce924f1176c.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d2cdbc836b87d82b4d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### WiSE-FT

Top-1 Accuracy: 98.1. Result ID: 6a0ad28e47f34ce924f11771.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d2cdbc836b87d82b4d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cd31e209131cea3601a.md>)

[Implementation](<https://github.com/mlfoundations/wise-ft>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### Simple Averaging

Top-1 Accuracy: 97.2. Result ID: 6a0c2667fbc373592c025eb5.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ce11e209131cea3679c.md>)

[Implementation](<https://github.com/mlfoundations/model-soups>)

Recorded evaluation configuration: {"Merging Strategy":"Simple Averaging","Quantization Method":"None","Model Backbone":"CLIP-ViT-B/32","Bit-width":"Full"}. This record does not assert independent reproduction.

### WUDI-Merging w/ E-PMQ

Top-1 Accuracy: 96.88. Result ID: 6a0c2667fbc373592c025ec8.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Implementation](<https://github.com/wwjzhy/E-PMQ>)

Recorded evaluation configuration: {"Merging Strategy":"WUDI-Merging","Quantization Method":"E-PMQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### CAR-FT

Top-1 Accuracy: 96.7. Result ID: 6a0ad28e47f34ce924f1176f.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d2cdbc836b87d82b4d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e081e209131cea3d8a2.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### Simple Averaging w/ GPTQ

Top-1 Accuracy: 96.63. Result ID: 6a0c2667fbc373592c025eb7.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ecc1e209131cea4235d.md>)

Recorded evaluation configuration: {"Merging Strategy":"Simple Averaging","Quantization Method":"GPTQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### Simple Averaging w/ RTN

Top-1 Accuracy: 96.45. Result ID: 6a0c2667fbc373592c025eb6.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ce11e209131cea3679c.md>)

[Implementation](<https://github.com/mlfoundations/model-soups>)

Recorded evaluation configuration: {"Merging Strategy":"Simple Averaging","Quantization Method":"RTN","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### WUDI-Merging

Top-1 Accuracy: 96.1. Result ID: 6a0c2667fbc373592c025ec4.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

Recorded evaluation configuration: {"Merging Strategy":"WUDI-Merging","Quantization Method":"None","Model Backbone":"CLIP-ViT-B/32","Bit-width":"Full"}. This record does not assert independent reproduction.

### Simple Averaging w/ AWQ

Top-1 Accuracy: 96.05. Result ID: 6a0c2667fbc373592c025eb8.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74241e209131cea5ff11.md>)

Recorded evaluation configuration: {"Merging Strategy":"Simple Averaging","Quantization Method":"AWQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### WUDI-Merging w/ GPTQ

Top-1 Accuracy: 95.66. Result ID: 6a0c2667fbc373592c025ec6.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ecc1e209131cea4235d.md>)

Recorded evaluation configuration: {"Merging Strategy":"WUDI-Merging","Quantization Method":"GPTQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### FT

Top-1 Accuracy: 95.3. Result ID: 6a0ad28e47f34ce924f1176d.

[Reporting paper](<https://www.sota2.com/research/paper/6a0a9d2cdbc836b87d82b4d7.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79af1e209131cea7edf0.md>)

Recorded evaluation configuration: {"Backbone":"ViT-B/16"}. This record does not assert independent reproduction.

### Simple Averaging w/ E-PMQ

Top-1 Accuracy: 95.1. Result ID: 6a0c2667fbc373592c025eb9.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Implementation](<https://github.com/wwjzhy/E-PMQ>)

Recorded evaluation configuration: {"Merging Strategy":"Simple Averaging","Quantization Method":"E-PMQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### WUDI-Merging w/ AWQ

Top-1 Accuracy: 94.95. Result ID: 6a0c2667fbc373592c025ec7.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74241e209131cea5ff11.md>)

Recorded evaluation configuration: {"Merging Strategy":"WUDI-Merging","Quantization Method":"AWQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### TIES-Merging

Top-1 Accuracy: 94.8. Result ID: 6a0c2667fbc373592c025ebf.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71091e209131cea4ecd8.md>)

Recorded evaluation configuration: {"Merging Strategy":"TIES-Merging","Quantization Method":"None","Model Backbone":"CLIP-ViT-B/32","Bit-width":"Full"}. This record does not assert independent reproduction.

### WUDI-Merging w/ RTN

Top-1 Accuracy: 94.7. Result ID: 6a0c2667fbc373592c025ec5.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

Recorded evaluation configuration: {"Merging Strategy":"WUDI-Merging","Quantization Method":"RTN","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### TIES-Merging w/ E-PMQ

Top-1 Accuracy: 94.59. Result ID: 6a0c2667fbc373592c025ec3.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Implementation](<https://github.com/wwjzhy/E-PMQ>)

Recorded evaluation configuration: {"Merging Strategy":"TIES-Merging","Quantization Method":"E-PMQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### TIES-Merging w/ GPTQ

Top-1 Accuracy: 94.45. Result ID: 6a0c2667fbc373592c025ec1.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ecc1e209131cea4235d.md>)

Recorded evaluation configuration: {"Merging Strategy":"TIES-Merging","Quantization Method":"GPTQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### Task Arithmetic w/ E-PMQ

Top-1 Accuracy: 94.25. Result ID: 6a0c2667fbc373592c025ebe.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Implementation](<https://github.com/wwjzhy/E-PMQ>)

Recorded evaluation configuration: {"Merging Strategy":"Task Arithmetic","Quantization Method":"E-PMQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### TIES-Merging w/ RTN

Top-1 Accuracy: 93.88. Result ID: 6a0c2667fbc373592c025ec0.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71091e209131cea4ecd8.md>)

Recorded evaluation configuration: {"Merging Strategy":"TIES-Merging","Quantization Method":"RTN","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### TIES-Merging w/ AWQ

Top-1 Accuracy: 93.45. Result ID: 6a0c2667fbc373592c025ec2.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74241e209131cea5ff11.md>)

Recorded evaluation configuration: {"Merging Strategy":"TIES-Merging","Quantization Method":"AWQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### Task Arithmetic

Top-1 Accuracy: 84.6. Result ID: 6a0c2667fbc373592c025eba.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef01e209131cea43012.md>)

Recorded evaluation configuration: {"Merging Strategy":"Task Arithmetic","Quantization Method":"None","Model Backbone":"CLIP-ViT-B/32","Bit-width":"Full"}. This record does not assert independent reproduction.

### Task Arithmetic w/ GPTQ

Top-1 Accuracy: 83.58. Result ID: 6a0c2667fbc373592c025ebc.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ecc1e209131cea4235d.md>)

Recorded evaluation configuration: {"Merging Strategy":"Task Arithmetic","Quantization Method":"GPTQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### Task Arithmetic w/ AWQ

Top-1 Accuracy: 83.55. Result ID: 6a0c2667fbc373592c025ebd.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74241e209131cea5ff11.md>)

Recorded evaluation configuration: {"Merging Strategy":"Task Arithmetic","Quantization Method":"AWQ","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

### Task Arithmetic w/ RTN

Top-1 Accuracy: 82.76. Result ID: 6a0c2667fbc373592c025ebb.

[Reporting paper](<https://www.sota2.com/research/paper/6a0beeb5dbc836b87d82c544.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef01e209131cea43012.md>)

Recorded evaluation configuration: {"Merging Strategy":"Task Arithmetic","Quantization Method":"RTN","Model Backbone":"CLIP-ViT-B/32","Bit-width":"4-bit"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
