Image Classification on Biased MNIST rho = 0.8
66.21AccuracyBlackVIP
Evaluation Results
| Method | Links | |
|---|---|---|
| BlackVIPBackbone=CLIP ViT-B/16, Encoder=vit-mae-base, Few-shot samples=162024.07 | 66.21 | |
| VP w/ SPSA-GCBackbone=CLIP ViT-B/16, Few-shot samples=16, Optimizer=SPSA-GC2024.07 | 60.34 | |
| VP (white-box)Backbone=CLIP ViT-B/16, Few-shot samples=16, Access=White-box2024.07 | 57.92 | |
| BlackVIP-SEBackbone=CLIP ViT-B/16, Encoder=PCA or kernel PCA, Few-shot samples=162024.07 | 55.73 | |
| BARBackbone=CLIP ViT-B/16, Few-shot samples=162024.07 | 53.25 | |
| ZSBackbone=CLIP ViT-B/16, Prompt=a photo of {classname}2024.07 | 37.56 |