# Object Recognition Faithfulness on ImageNet ILSVRC 2012 (val)

Source: [Object Recognition Faithfulness on ImageNet ILSVRC 2012 (val)](<https://www.sota2.com/research/sota/object-recognition-faithfulness-on-imagenet-ilsvrc-2012-val>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:36:08.928Z

Evaluation of the faithfulness or robustness of object recognition models on the validation split of the ImageNet ILSVRC 2012 dataset, measured by the average performance drop or increase under specific perturbations.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Object Recognition Faithfulness |
| Dataset (including any stated split) | ImageNet ILSVRC 2012 (val) |
| Metric | Avg Drop |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 5 of 5 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Avg Drop](<https://www.sota2.com/research/sota/object-recognition-faithfulness-on-imagenet-ilsvrc-2012-val.md?metric=Avg%20Drop>): Lower is better; unit: PERCENT.

- [Avg Increase](<https://www.sota2.com/research/sota/object-recognition-faithfulness-on-imagenet-ilsvrc-2012-val.md?metric=Avg%20Increase>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Avg Drop | Result date | Report paper |
| --- | --- | --- | --- |
| Score-CAM | 31.5 | Not recorded | 68fa675c1e209131cea15d45 |
| Grad-CAM++ | 45.5 | Not recorded | 68fa675c1e209131cea15d45 |
| RISE | 47 | Not recorded | 68fa675c1e209131cea15d45 |
| Grad-CAM | 47.8 | Not recorded | 68fa675c1e209131cea15d45 |
| Mask | 63.5 | Not recorded | 68fa675c1e209131cea15d45 |

### Score-CAM

Avg Drop: 31.5. Result ID: 698d308f8b517eb4331fabe7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa675c1e209131cea15d45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa675c1e209131cea15d45.md>)

[Implementation](<https://github.com/haofanwang/Score-CAM>)

Recorded evaluation configuration: {"Muted Pixels":"50%","Base Model":"VGG-16"}. This record does not assert independent reproduction.

### Grad-CAM++

Avg Drop: 45.5. Result ID: 698d308f8b517eb4331fabe6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa675c1e209131cea15d45.md>)

Recorded evaluation configuration: {"Muted Pixels":"50%","Base Model":"VGG-16"}. This record does not assert independent reproduction.

### RISE

Avg Drop: 47. Result ID: 698d308f8b517eb4331fabe4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa675c1e209131cea15d45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64dc1e209131cea06cb9.md>)

[Implementation](<https://github.com/pytorch/vision>)

Recorded evaluation configuration: {"Muted Pixels":"50%","Base Model":"VGG-16"}. This record does not assert independent reproduction.

### Grad-CAM

Avg Drop: 47.8. Result ID: 698d308f8b517eb4331fabe5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa675c1e209131cea15d45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66cb1e209131cea12568.md>)

[Implementation](<https://github.com/ramprs/grad-cam/>)

Recorded evaluation configuration: {"Muted Pixels":"50%","Base Model":"VGG-16"}. This record does not assert independent reproduction.

### Mask

Avg Drop: 63.5. Result ID: 698d308f8b517eb4331fabe3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa675c1e209131cea15d45.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b631e209131cea2df25.md>)

Recorded evaluation configuration: {"Muted Pixels":"50%","Base Model":"VGG-16"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.