Few-shot classification on OOD Datasets (test)
91.33Accuracy (Traffic Signs)SMAT
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SMATFine-tuning protocol=Full, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 91.33 | 63.11 | 92.21 | 86.12 | 96.73 | 56.67 | 91.97 | 65.79 | 66.99 | 42.39 | 75.32 | |
| SMATFine-tuning protocol=LoRA, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 90.18 | 63.38 | 92.46 | 85.88 | 96.46 | 55.63 | 92.31 | 66.07 | 67.77 | 40.05 | 75.02 | |
| SoftMergeFine-tuning protocol=Full, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 89.91 | 62.15 | 91.84 | 85.88 | 96.2 | 53.85 | 90.48 | 65.5 | 63.36 | 41.62 | 74.08 | |
| PMFFine-tuning protocol=LoRA, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 89.14 | 61.71 | 91.53 | 85.06 | 96.41 | 47.59 | 92.01 | 60.6 | 62.71 | 42.37 | 72.91 | |
| PMFFine-tuning protocol=Full, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 88.85 | 62.59 | 89.61 | 82.54 | 96.44 | 49.65 | 91.73 | 62.83 | 62.97 | 40.07 | 72.73 | |
| Pre-trainedFine-tuning protocol=LoRA, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 88.1 | 62.1 | 93.33 | 86.17 | 94.98 | 57.34 | 92.06 | 66.51 | 65.06 | 39.49 | 74.51 | |
| Pre-trainedFine-tuning protocol=Full, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 87.3 | 61.5 | 92.48 | 86.13 | 92.54 | 56.39 | 92.03 | 67.18 | 65.08 | 40.98 | 74.16 | |
| SMATFine-tuning protocol=None, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 57.72 | 58.81 | 87.05 | 77.46 | 94.43 | 47.76 | 91.97 | 58.97 | 65.59 | 36.79 | 67.65 | |
| SoftMergeFine-tuning protocol=None, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 56.21 | 55.75 | 84.58 | 70.85 | 94.16 | 43.3 | 89.84 | 54.83 | 63.04 | 36.21 | 64.87 | |
| PMFFine-tuning protocol=None, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 54.37 | 57.04 | 80.82 | 69.11 | 93.33 | 41.1 | 91.37 | 53.92 | 61.89 | 38 | 64.1 | |
| Pre-trainedFine-tuning protocol=None, Backbone=DINO-ViT-Small, Classifier=ProtoNet2024.03 | 53.7 | 54.58 | 85.64 | 76.86 | 78.57 | 47.25 | 91.73 | 55.19 | 62.64 | 34.58 | 64.07 |