Interpretability Evaluation on MS COCO
1.83Interpretation Error RateHarmonica-3rd
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Harmonica-3rdRadius=1, Number of Superpixels=162022.10 | 1.83 | — | — | |
| Harmonica-3rdRadius=2, Number of Superpixels=162022.10 | 2.18 | — | — | |
| Harmonica-3rdRadius=4, Number of Superpixels=162022.10 | 2.41 | — | — | |
| Harmonica-3rdRadius=8, Number of Superpixels=162022.10 | 2.44 | — | — | |
| Harmonica-3rdRadius=16, Number of Superpixels=162022.10 | 2.44 | — | — | |
| Harmonica-2ndRadius=1, Number of Superpixels=162022.10 | 2.91 | — | — | |
| Harmonica-2ndRadius=2, Number of Superpixels=162022.10 | 3.32 | — | — | |
| Harmonica-2ndRadius=4, Number of Superpixels=162022.10 | 3.63 | — | — | |
| Harmonica-2ndRadius=8, Number of Superpixels=162022.10 | 3.67 | — | — | |
| Harmonica-2ndRadius=16, Number of Superpixels=162022.10 | 3.67 | — | — | |
| SHAPRadius=1, Number of Superpixels=162022.10 | 19.52 | — | — | |
| SHAPRadius=2, Number of Superpixels=162022.10 | 20.36 | — | — | |
| SHAPRadius=4, Number of Superpixels=162022.10 | 20.41 | — | — | |
| SHAPRadius=8, Number of Superpixels=162022.10 | 20.42 | — | — | |
| SHAPRadius=16, Number of Superpixels=162022.10 | 20.42 | — | — | |
| LIMERadius=1, Number of Superpixels=162022.10 | 22.64 | — | — | |
| Faith-ShapRadius=8, Number of Superpixels=162022.10 | 23.47 | — | — | |
| Faith-ShapRadius=16, Number of Superpixels=162022.10 | 23.47 | — | — | |
| Faith-ShapRadius=4, Number of Superpixels=162022.10 | 23.49 | — | — | |
| Faith-ShapRadius=2, Number of Superpixels=162022.10 | 23.97 | — | — | |
| Faith-ShapRadius=1, Number of Superpixels=162022.10 | 24.28 | — | — | |
| LIMERadius=2, Number of Superpixels=162022.10 | 24.51 | — | — | |
| LIMERadius=4, Number of Superpixels=162022.10 | 24.78 | — | — | |
| LIMERadius=8, Number of Superpixels=162022.10 | 24.79 | — | — | |
| LIMERadius=16, Number of Superpixels=162022.10 | 24.79 | — | — | |
| Shapley TaylorRadius=8, Number of Superpixels=162022.10 | 32.67 | — | — | |
| Shapley TaylorRadius=16, Number of Superpixels=162022.10 | 32.67 | — | — | |
| Shapley TaylorRadius=4, Number of Superpixels=162022.10 | 32.69 | — | — | |
| Shapley TaylorRadius=2, Number of Superpixels=162022.10 | 33.13 | — | — | |
| IGRadius=16, Number of Superpixels=162022.10 | 34.38 | — | — | |
| IGRadius=8, Number of Superpixels=162022.10 | 34.62 | — | — | |
| IGRadius=4, Number of Superpixels=162022.10 | 34.64 | — | — | |
| IGRadius=1, Number of Superpixels=162022.10 | 34.73 | — | — | |
| IGRadius=2, Number of Superpixels=162022.10 | 35.15 | — | — | |
| Shapley TaylorRadius=1, Number of Superpixels=162022.10 | 35.54 | — | — | |
| IHRadius=1, Number of Superpixels=162022.10 | 137.17 | — | — | |
| IHRadius=2, Number of Superpixels=162022.10 | 150.47 | — | — | |
| IHRadius=4, Number of Superpixels=162022.10 | 151.41 | — | — | |
| IHRadius=8, Number of Superpixels=162022.10 | 151.41 | — | — | |
| IHRadius=16, Number of Superpixels=162022.10 | 151.41 | — | — | |
| LaViSEModel & Layer=ResNet-18 Layer 4, Reference dataset=MS COCO2022.04 | — | 70 | 49 | |
| LaViSEModel & Layer=ResNet-50 Layer 4, Reference dataset=MS COCO2022.04 | — | 68 | 48 | |
| NetDissectModel & Layer=ResNet-18 Layer 4, Reference dataset=MS COCO2022.04 | — | 42 | 12 | |
| NetDissectModel & Layer=ResNet-50 Layer 4, Reference dataset=MS COCO2022.04 | — | 38 | 12 |