Misclassification Explanation Evaluation on ImageNet-1K misclassified samples 1.0 (test)
1.934Directional Score (Mean)FaithTrace
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FaithTraceModel=DINO ResNet-50, Setting=Top-12026.05 | 1.934 | 0 | 3.461 | 8.912 | |
| TEXTERModel=DINO ResNet-50, Setting=Top-12026.05 | 0.723 | 0.2 | -0.101 | 3.286 | |
| Text-To-ConceptModel=DINO ResNet-50, Setting=Top-12026.05 | 0.505 | 0.18 | -0.482 | 2.756 | |
| FaithTraceModel=ResNet-18, Setting=Top-12026.05 | 0.227 | 0 | 2.725 | 5.4 | |
| FaithTraceModel=ViT, Setting=Top-12026.05 | 0.148 | 0 | 1.057 | 1.289 | |
| FaithTraceModel=ResNet-50, Setting=Top-12026.05 | 0.083 | 0 | 1.593 | 1.981 | |
| TEXTERModel=ResNet-18, Setting=Top-12026.05 | 0.075 | 0.225 | 0.45 | 2.485 | |
| TEXTERModel=ViT, Setting=Top-12026.05 | 0.055 | 0.22 | 0.47 | 0.633 | |
| Text-To-ConceptModel=ResNet-18, Setting=Top-12026.05 | 0.053 | 0.3 | -0.489 | 1.215 | |
| FaithTraceModel=DINO ViT-S/8, Setting=Top-12026.05 | 0.052 | 0.01 | 3.986 | 8.808 | |
| TEXTERModel=ResNet-50, Setting=Top-12026.05 | 0.047 | 0.13 | 0.73 | 1.036 | |
| Text-To-ConceptModel=ViT, Setting=Top-12026.05 | 0.039 | 0.34 | 0.178 | 0.29 | |
| Text-To-ConceptModel=ResNet-50, Setting=Top-12026.05 | 0.024 | 0.19 | 0.333 | 0.557 | |
| Text-To-ConceptModel=DINO ViT-S/8, Setting=Top-12026.05 | 0.003 | 0.49 | -1.995 | 3.051 | |
| TEXTERModel=DINO ViT-S/8, Setting=Top-12026.05 | -0.012 | 0.68 | -1.85 | 2.309 | |
| RandomModel=ViT, Setting=Top-12026.05 | -0.016 | 0.57 | 0.21 | 0.286 | |
| RandomModel=DINO ViT-S/8, Setting=Top-12026.05 | -0.022 | 0.74 | -1.853 | 2.382 | |
| RandomModel=ResNet-50, Setting=Top-12026.05 | -0.027 | 0.65 | 0.318 | 0.505 | |
| RandomModel=ResNet-18, Setting=Top-12026.05 | -0.041 | 0.64 | 0.171 | 1.663 | |
| RandomModel=DINO ResNet-50, Setting=Top-12026.05 | -0.286 | 0.61 | 0.159 | 3.505 |