# Fine-grained Classification on SUN397 (novel classes)

Source: [Fine-grained Classification on SUN397 (novel classes)](<https://www.sota2.com/research/sota/fine-grained-classification-on-sun397-novel-classes>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-27T14:19:33.316Z

Evaluation of Fine-grained Classification performance on the novel classes subset of the SUN397 dataset, reporting Top-1 Accuracy and Expected Calibration Error (ECE).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Fine-grained classification |
| Dataset (including any stated split) | SUN397 (novel classes) |
| Metric | ECE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 43 of 43 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [ECE](<https://www.sota2.com/research/sota/fine-grained-classification-on-sun397-novel-classes.md?metric=ECE>): Lower is better; unit: SCALAR.

- [Top-1 Acc](<https://www.sota2.com/research/sota/fine-grained-classification-on-sun397-novel-classes.md?metric=Top-1%20Acc>): Higher is better; unit: PERCENT.

- [MCE](<https://www.sota2.com/research/sota/fine-grained-classification-on-sun397-novel-classes.md?metric=MCE>): Lower is better; unit: SCALAR.

- [ACE](<https://www.sota2.com/research/sota/fine-grained-classification-on-sun397-novel-classes.md?metric=ACE>): Lower is better; unit: SCALAR.

## Recorded results

| Method | ECE | Result date | Report paper |
| --- | --- | --- | --- |
| TCPT | 0.77 | Not recorded | 699d30716017c4460ffab2ff |
| DAC | 0.79 | Not recorded | 699d30716017c4460ffab2ff |
| TCPT | 0.87 | Not recorded | 699d30716017c4460ffab2ff |
| DAC | 1.06 | Not recorded | 699d30716017c4460ffab2ff |
| PromptSRC | 1.07 | Not recorded | 699d30716017c4460ffab2ff |
| DAC | 1.09 | Not recorded | 699d30716017c4460ffab2ff |
| TCPT | 1.11 | Not recorded | 699d30716017c4460ffab2ff |
| DAC | 1.32 | Not recorded | 699d30716017c4460ffab2ff |
| KGCoOp | 1.66 | Not recorded | 699d30716017c4460ffab2ff |
| TCPT | 1.9 | Not recorded | 699d30716017c4460ffab2ff |
| TCPT | 1.91 | Not recorded | 699d30716017c4460ffab2ff |
| ProGrad | 2.05 | Not recorded | 699d30716017c4460ffab2ff |
| MaPLe | 2.21 | Not recorded | 699d30716017c4460ffab2ff |
| CoCoOp | 2.21 | Not recorded | 699d30716017c4460ffab2ff |
| TCPT | 2.32 | Not recorded | 699d30716017c4460ffab2ff |
| Penalty | 2.51 | Not recorded | 699d30716017c4460ffab2ff |
| TCPT | 3.08 | Not recorded | 699d30716017c4460ffab2ff |
| Penalty | 3.08 | Not recorded | 699d30716017c4460ffab2ff |
| Zero Shot | 3.48 | Not recorded | 699d30716017c4460ffab2ff |
| Zero Shot | 3.48 | Not recorded | 699d30716017c4460ffab2ff |
| ZS-Norm | 3.57 | Not recorded | 699d30716017c4460ffab2ff |
| Penalty | 3.93 | Not recorded | 699d30716017c4460ffab2ff |
| ZS-Norm | 3.99 | Not recorded | 699d30716017c4460ffab2ff |
| Penalty | 4.53 | Not recorded | 699d30716017c4460ffab2ff |
| ZS-Norm | 7.1 | Not recorded | 699d30716017c4460ffab2ff |
| ZS-Norm | 12.12 | Not recorded | 699d30716017c4460ffab2ff |
| CoOp | 13.7 | Not recorded | 699d30716017c4460ffab2ff |
| ProDA | 14.08 | Not recorded | 699d30716017c4460ffab2ff |

### TCPT

ECE: 0.77. Result ID: 69a1a7d535dfcabb00e80173.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"PromptSRC","Calibration method":"TCPT"}. This record does not assert independent reproduction.

### DAC

ECE: 0.79. Result ID: 69a1a7d535dfcabb00e80172.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73a41e209131cea5da1b.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"PromptSRC","Calibration method":"DAC"}. This record does not assert independent reproduction.

### TCPT

ECE: 0.87. Result ID: 69a1a7d535dfcabb00e80164.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"CoCoOp","Calibration method":"TCPT"}. This record does not assert independent reproduction.

### DAC

ECE: 1.06. Result ID: 69a1a7d535dfcabb00e80168.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73a41e209131cea5da1b.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"ProDA","Calibration method":"DAC"}. This record does not assert independent reproduction.

### PromptSRC

ECE: 1.07. Result ID: 69a1a7d535dfcabb00e8016f.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa705e1e209131cea4aa58.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"PromptSRC","Calibration method":"Vanilla"}. This record does not assert independent reproduction.

### DAC

ECE: 1.09. Result ID: 69a1a7d535dfcabb00e80163.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73a41e209131cea5da1b.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"CoCoOp","Calibration method":"DAC"}. This record does not assert independent reproduction.

### TCPT

ECE: 1.11. Result ID: 69a1a7d535dfcabb00e80051.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"MaPLe","Calibration strategy":"TCPT"}. This record does not assert independent reproduction.

### DAC

ECE: 1.32. Result ID: 69a1a7d535dfcabb00e8016d.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73a41e209131cea5da1b.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"ProGrad","Calibration method":"DAC"}. This record does not assert independent reproduction.

### KGCoOp

ECE: 1.66. Result ID: 69a1a7d535dfcabb00e80052.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee91e209131cea42d7a.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"KGCoOp","Calibration strategy":"None"}. This record does not assert independent reproduction.

### TCPT

ECE: 1.9. Result ID: 69a1a7d535dfcabb00e80169.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"ProDA","Calibration method":"TCPT"}. This record does not assert independent reproduction.

### TCPT

ECE: 1.91. Result ID: 69a1a7d535dfcabb00e80053.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"KGCoOp","Calibration strategy":"TCPT"}. This record does not assert independent reproduction.

### ProGrad

ECE: 2.05. Result ID: 69a1a7d535dfcabb00e8016a.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a981e209131cea841f7.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"ProGrad","Calibration method":"Vanilla"}. This record does not assert independent reproduction.

### MaPLe

ECE: 2.21. Result ID: 69a1a7d535dfcabb00e80050.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ef21e209131cea4311c.md>)

[Implementation](<https://github.com/muzairkhattak/multimodal-prompt-learning>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"MaPLe","Calibration strategy":"None"}. This record does not assert independent reproduction.

### CoCoOp

ECE: 2.21. Result ID: 69a1a7d535dfcabb00e80160.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d8c1e209131cea3a831.md>)

[Implementation](<https://github.com/KaiyangZhou/CoOp>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"CoCoOp","Calibration method":"Vanilla"}. This record does not assert independent reproduction.

### TCPT

ECE: 2.32. Result ID: 69a1a7d535dfcabb00e8016e.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"ProGrad","Calibration method":"TCPT"}. This record does not assert independent reproduction.

### Penalty

ECE: 2.51. Result ID: 69a1a7d535dfcabb00e80167.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74301e209131cea60514.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"ProDA","Calibration method":"Penalty"}. This record does not assert independent reproduction.

### TCPT

ECE: 3.08. Result ID: 69a1a7d535dfcabb00e8004f.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"CoOp","Calibration strategy":"TCPT"}. This record does not assert independent reproduction.

### Penalty

ECE: 3.08. Result ID: 69a1a7d535dfcabb00e8016c.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74301e209131cea60514.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"ProGrad","Calibration method":"Penalty"}. This record does not assert independent reproduction.

### Zero Shot

ECE: 3.48. Result ID: 69a1a7d535dfcabb00e8004d.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"None","Calibration strategy":"None"}. This record does not assert independent reproduction.

### Zero Shot

ECE: 3.48. Result ID: 69a1a7d535dfcabb00e8015f.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69581e209131cea21ad0.md>)

[Implementation](<https://github.com/OpenAI/CLIP>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"Zero Shot","Calibration method":"None"}. This record does not assert independent reproduction.

### ZS-Norm

ECE: 3.57. Result ID: 69a1a7d535dfcabb00e80170.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74301e209131cea60514.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"PromptSRC","Calibration method":"ZS-Norm"}. This record does not assert independent reproduction.

### Penalty

ECE: 3.93. Result ID: 69a1a7d535dfcabb00e80162.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74301e209131cea60514.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"CoCoOp","Calibration method":"Penalty"}. This record does not assert independent reproduction.

### ZS-Norm

ECE: 3.99. Result ID: 69a1a7d535dfcabb00e80161.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74301e209131cea60514.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"CoCoOp","Calibration method":"ZS-Norm"}. This record does not assert independent reproduction.

### Penalty

ECE: 4.53. Result ID: 69a1a7d535dfcabb00e80171.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74301e209131cea60514.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"PromptSRC","Calibration method":"Penalty"}. This record does not assert independent reproduction.

### ZS-Norm

ECE: 7.1. Result ID: 69a1a7d535dfcabb00e8016b.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74301e209131cea60514.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"ProGrad","Calibration method":"ZS-Norm"}. This record does not assert independent reproduction.

### ZS-Norm

ECE: 12.12. Result ID: 69a1a7d535dfcabb00e80166.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74301e209131cea60514.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"ProDA","Calibration method":"ZS-Norm"}. This record does not assert independent reproduction.

### CoOp

ECE: 13.7. Result ID: 69a1a7d535dfcabb00e8004e.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d8b1e209131cea3a814.md>)

[Implementation](<https://github.com/KaiyangZhou/CoOp>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"CoOp","Calibration strategy":"None"}. This record does not assert independent reproduction.

### ProDA

ECE: 14.08. Result ID: 69a1a7d535dfcabb00e80165.

[Reporting paper](<https://www.sota2.com/research/paper/699d30716017c4460ffab2ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ee91e209131cea42d7a.md>)

Recorded evaluation configuration: {"Prompt-tuning strategy":"ProDA","Calibration method":"Vanilla"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.