Classification rule reverse engineering on CLEVR 1.0 (test)
0.717CaCEGIFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GIFTArchitecture=ViT-Small-Patch16-224, Ground Truth Rule=Yellow rubber object2024.11 | 0.717 | 0.717 | |
| GIFTArchitecture=ResNet-34, Ground Truth Rule=Purple object2024.11 | 0.712 | 0.712 | |
| GIFTArchitecture=ViT-Small-Patch16-224, Ground Truth Rule=Red metal object2024.11 | 0.707 | 0.707 | |
| GIFTArchitecture=ViT-Small-Patch16-224, Ground Truth Rule=Purple object2024.11 | 0.702 | 0.702 | |
| GIFTArchitecture=ResNet-34, Ground Truth Rule=Yellow rubber object2024.11 | 0.672 | 0.677 | |
| GIFTArchitecture=ViT-Small-Patch16-224, Ground Truth Rule=Cyan object2024.11 | 0.631 | 0.631 | |
| GIFTArchitecture=ResNet-34, Ground Truth Rule=Cyan object2024.11 | 0.622 | 0.622 | |
| GIFTArchitecture=ViT-Small-Patch16-224, Ground Truth Rule=Metal object2024.11 | 0.374 | 0.374 | |
| GIFTArchitecture=ViT-Small-Patch16-224, Ground Truth Rule=Rubber object2024.11 | 0.308 | 0.313 | |
| GIFTArchitecture=ResNet-34, Ground Truth Rule=Rubber object2024.11 | 0.298 | 0.298 | |
| GIFTArchitecture=ResNet-34, Ground Truth Rule=Metal object2024.11 | 0.242 | 0.242 |