Pointing game on MSCOCO 2014 (val)
69.9Mean Accuracy (All)CAMERAS
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| CAMERASBackbone=ResNet502021.06 | 69.9 | — | 66.4 | — | |
| CMWPBackbone=ResNet502021.06 | 58.5 | — | 53.6 | — | |
| CMWPBackbone=ResNet50, Box type=White box, Batch size=642021.11 | 58.5 | — | 53.6 | 0.04 | |
| Sobol signed (STi±)Backbone=ResNet50, Box type=Black box, Batch size=642021.11 | 57.5 | — | 53.1 | 6.721 | |
| GradCAMBackbone=ResNet502021.06 | 57.3 | — | 52.3 | — | |
| GradCAMBackbone=ResNet50, Box type=White box, Batch size=642021.11 | 57.3 | — | 52.3 | 0.015 | |
| Sobol (STi)Backbone=ResNet50, Box type=Black box, Batch size=642021.11 | 57.3 | — | 52.7 | 6.381 | |
| Extremal*Backbone=ResNet502021.06 | 56.5 | — | 51.5 | — | |
| ExtremalPerturbationBackbone=ResNet50, Box type=White box, Batch size=642021.11 | 56.5 | — | 51.5 | 26.48 | |
| CAMERASBackbone=VGG162021.06 | 55.4 | — | 50.7 | — | |
| Sobol signed (STi±)Backbone=VGG16, Box type=Black box2021.11 | 55.2 | — | 49.9 | — | |
| RISE*Backbone=ResNet502021.06 | 54.7 | — | 50 | — | |
| RISEBackbone=ResNet50, Box type=Black box, Batch size=642021.11 | 54.7 | — | 50 | 13.19 | |
| Sobol (STi)Backbone=VGG16, Box type=Black box2021.11 | 54.6 | — | 49.6 | — | |
| GradCAMBackbone=VGG162021.06 | 54.2 | — | 49 | — | |
| GradCAMBackbone=VGG16, Box type=White box2021.11 | 54.2 | — | 49 | — | |
| Extremal*Backbone=VGG162021.06 | 51.5 | — | 45.9 | — | |
| ExtremalPerturbationBackbone=VGG16, Box type=White box2021.11 | 51.5 | — | 45.9 | — | |
| RISE*Backbone=VGG162021.06 | 50.8 | — | 45.3 | — | |
| RISEBackbone=VGG16, Box type=Black box2021.11 | 50.8 | — | 45.3 | — | |
| CMWPBackbone=VGG162021.06 | 49.7 | — | 44.3 | — | |
| CMWPBackbone=VGG16, Box type=White box2021.11 | 49.7 | — | 44.3 | — | |
| MWPBackbone=ResNet502021.06 | 49.6 | — | 43.9 | — | |
| MWPBackbone=ResNet50, Box type=White box, Batch size=642021.11 | 49.6 | — | 43.9 | 0.039 | |
| GuidBackbone=ResNet502021.06 | 42.1 | — | 35.3 | — | |
| Guided-Backprop.Backbone=ResNet50, Box type=White box, Batch size=642021.11 | 42.1 | — | 35.3 | 0.051 | |
| MWPBackbone=VGG162021.06 | 39.8 | — | 32.8 | — | |
| MWPBackbone=VGG16, Box type=White box2021.11 | 39.8 | — | 32.8 | — | |
| GuidBackbone=VGG162021.06 | 39.1 | — | 31.4 | — | |
| Guided-Backprop.Backbone=VGG16, Box type=White box2021.11 | 39.1 | — | 31.4 | — | |
| GradientBackbone=VGG162021.06 | 37.7 | — | 31.4 | — | |
| SaliencyBackbone=VGG16, Box type=White box2021.11 | 37.7 | — | 31.4 | — | |
| GradientBackbone=ResNet502021.06 | 35 | — | 29.4 | — | |
| SaliencyBackbone=ResNet50, Box type=White box, Batch size=642021.11 | 35 | — | 29.4 | 0.031 | |
| DeConv.Backbone=VGG162021.06 | 30.7 | — | 23 | — | |
| DeconvNetBackbone=VGG16, Box type=White box2021.11 | 30.7 | — | 23 | — | |
| DeConv.Backbone=ResNet502021.06 | 30 | — | 21.9 | — | |
| DeconvNetBackbone=ResNet50, Box type=White box, Batch size=642021.11 | 30 | — | 21.9 | 0.029 | |
| CenterBackbone=VGG162021.06 | 27.8 | — | 19.5 | — | |
| CenterBackbone=ResNet502021.06 | 27.8 | — | 19.5 | — | |
| Baseline CenterBackbone=VGG162021.11 | 27.8 | — | 19.5 | — | |
| Baseline CenterBackbone=ResNet502021.11 | 27.8 | — | 19.5 | — | |
| AMBase model=VGG162018.06 | — | 37.1 | — | — | |
| AMBase model=Resnet502018.06 | — | 30.4 | — | — | |
| c-MWPBase model=VGG162018.06 | — | 49.6 | — | — | |
| c-MWPBase model=Resnet502018.06 | — | 57.4 | — | — | |
| CAMBase model=Resnet502018.06 | — | 58.4 | — | — | |
| DeconvBase model=VGG162018.06 | — | 38.6 | — | — | |
| DeconvBase model=Resnet502018.06 | — | 38.2 | — | — | |
| MWPBase model=VGG162018.06 | — | 39.5 | — | — | |
| MWPBase model=Resnet502018.06 | — | 46.8 | — | — | |
| RISEBase model=VGG162018.06 | — | 50.71 | — | — | |
| RISEBase model=Resnet502018.06 | — | 55.58 | — | — |