Faithfulness Evaluation on ImageNet-1K
1.293Insertion ScoreFaithTrace
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FaithTraceModel=DINO ViT-S/8, Top-k=12026.05 | 1.293 | 4.433 | |
| FaithTraceModel=DINO ViT-S/8, Top-k=52026.05 | 1.036 | 3.768 | |
| FaithTraceModel=ResNet-18, Top-k=12026.05 | 0.961 | 2.096 | |
| FaithTraceModel=ResNet-18, Top-k=52026.05 | 0.793 | 1.774 | |
| FaithTraceModel=DINO ResNet-50, Top-k=12026.05 | 0.75 | 3.642 | |
| FaithTraceModel=DINO ResNet-50, Top-k=52026.05 | 0.628 | 3.036 | |
| FaithTraceModel=ResNet-50, Top-k=12026.05 | 0.373 | 0.55 | |
| FaithTraceModel=ResNet-50, Top-k=52026.05 | 0.304 | 0.445 | |
| FaithTraceModel=ViT, Top-k=12026.05 | 0.217 | 0.31 | |
| TEXTERModel=ResNet-18, Top-k=12026.05 | 0.204 | 1.021 | |
| FaithTraceModel=ViT, Top-k=52026.05 | 0.178 | 0.253 | |
| TEXTERModel=ResNet-18, Top-k=52026.05 | 0.14 | 0.67 | |
| TEXTERModel=ResNet-50, Top-k=12026.05 | 0.122 | 0.258 | |
| TEXTERModel=ResNet-50, Top-k=52026.05 | 0.089 | 0.203 | |
| TEXTERModel=ViT, Top-k=12026.05 | 0.047 | 0.114 | |
| TEXTERModel=ViT, Top-k=52026.05 | 0.02 | 0.076 | |
| RandomModel=ResNet-50, Top-k=52026.05 | 0.018 | 0.095 | |
| Text-To-ConceptModel=ResNet-50, Top-k=52026.05 | 0.007 | 0.099 | |
| Text-To-ConceptModel=ViT, Top-k=52026.05 | 0.003 | 0.056 | |
| Text-To-ConceptModel=ResNet-50, Top-k=12026.05 | -0.001 | 0.095 | |
| RandomModel=ResNet-50, Top-k=12026.05 | -0.002 | 0.073 | |
| RandomModel=ViT, Top-k=52026.05 | -0.023 | 0.024 | |
| RandomModel=ViT, Top-k=12026.05 | -0.025 | 0.026 | |
| RandomModel=ResNet-18, Top-k=52026.05 | -0.034 | 0.489 | |
| Text-To-ConceptModel=ResNet-18, Top-k=12026.05 | -0.068 | 0.507 | |
| RandomModel=ResNet-18, Top-k=12026.05 | -0.072 | 0.454 | |
| Text-To-ConceptModel=ResNet-18, Top-k=52026.05 | -0.105 | 0.493 | |
| RandomModel=DINO ResNet-50, Top-k=52026.05 | -0.422 | 0.978 | |
| TEXTERModel=DINO ResNet-50, Top-k=52026.05 | -0.43 | 1.349 | |
| RandomModel=DINO ResNet-50, Top-k=12026.05 | -0.454 | 0.955 | |
| TEXTERModel=DINO ResNet-50, Top-k=12026.05 | -0.469 | 1.428 | |
| Text-To-ConceptModel=DINO ResNet-50, Top-k=12026.05 | -0.534 | 1.037 | |
| Text-To-ConceptModel=DINO ResNet-50, Top-k=52026.05 | -0.54 | 1.009 | |
| Text-To-ConceptModel=DINO ViT-S/8, Top-k=12026.05 | -0.703 | 1.376 | |
| RandomModel=DINO ViT-S/8, Top-k=52026.05 | -0.811 | 1.155 | |
| TEXTERModel=DINO ViT-S/8, Top-k=52026.05 | -0.821 | 1.245 | |
| Text-To-ConceptModel=DINO ViT-S/8, Top-k=52026.05 | -0.881 | 1.265 | |
| TEXTERModel=DINO ViT-S/8, Top-k=12026.05 | -0.884 | 1.193 | |
| RandomModel=DINO ViT-S/8, Top-k=12026.05 | -0.948 | 1.009 | |
| Text-To-ConceptModel=ViT, Top-k=12026.05 | -21.047 | 0.053 |