Textual explanation faithfulness evaluation on ImageNet-1K 1,000 images sampled (test)
1.103Insertion ScoreFaithTrace
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FaithTraceBackbone=DINO ViT-S/8, Top-k retrieval=top-32026.05 | 1.103 | 3.974 | |
| FaithTraceBackbone=ResNet-18, Top-k retrieval=top-32026.05 | 0.87 | 1.925 | |
| FaithTraceBackbone=DINO ResNet-50, Top-k retrieval=top-32026.05 | 0.734 | 3.29 | |
| FaithTraceBackbone=ResNet-50, Top-k retrieval=top-32026.05 | 0.323 | 0.479 | |
| FaithTraceBackbone=ViT, Top-k retrieval=top-32026.05 | 0.193 | 0.272 | |
| TEXTERBackbone=ResNet-18, Top-k retrieval=top-32026.05 | 0.159 | 0.933 | |
| TEXTERBackbone=ResNet-50, Top-k retrieval=top-32026.05 | 0.099 | 0.22 | |
| TEXTERBackbone=ViT, Top-k retrieval=top-32026.05 | 0.028 | 0.087 | |
| RandomBackbone=ResNet-50, Top-k retrieval=top-32026.05 | 0.018 | 0.09 | |
| Text-To-ConceptBackbone=ViT, Top-k retrieval=top-32026.05 | 0.007 | 0.061 | |
| Text-To-ConceptBackbone=ResNet-50, Top-k retrieval=top-32026.05 | 0.002 | 0.096 | |
| RandomBackbone=ViT, Top-k retrieval=top-32026.05 | -0.015 | 0.033 | |
| RandomBackbone=ResNet-18, Top-k retrieval=top-32026.05 | -0.069 | 0.458 | |
| Text-To-ConceptBackbone=ResNet-18, Top-k retrieval=top-32026.05 | -0.092 | 0.492 | |
| RandomBackbone=DINO ResNet-50, Top-k retrieval=top-32026.05 | -0.401 | 1.043 | |
| TEXTERBackbone=DINO ResNet-50, Top-k retrieval=top-32026.05 | -0.424 | 1.379 | |
| Text-To-ConceptBackbone=DINO ResNet-50, Top-k retrieval=top-32026.05 | -0.559 | 0.975 | |
| RandomBackbone=DINO ViT-S/8, Top-k retrieval=top-32026.05 | -0.732 | 1.317 | |
| TEXTERBackbone=DINO ViT-S/8, Top-k retrieval=top-32026.05 | -0.737 | 1.304 | |
| Text-To-ConceptBackbone=DINO ViT-S/8, Top-k retrieval=top-32026.05 | -0.832 | 1.286 |