Image Classification on CIFAR10 (test) (Custom Metrics RB1-RB12)
96.2Custom Metric RB12CLIP (zero-shot)
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CLIP (zero-shot)Backbone=ViT-L-142026.05 | 96.2 | — | — | — | — | — | — | — | — | — | — | — | |
| CLIP (zero-shot)Backbone=ViT-B-322026.05 | 91.3 | — | — | — | — | — | — | — | — | — | — | — | |
| JumperLoss=Ls, SF=Cosine, AP=164.5k, Backbone=ViT-B-322026.05 | 91 | 40 | 46 | 50 | 56 | 62 | 76 | 80 | 84 | 86 | 91 | 92 | |
| T-GEMs + JumperLoss=Lr + Ls, SF=Cosine, AP=362k, Backbone=ViT-B-322026.05 | 91 | 41 | 47 | 55 | 60 | 68 | 77 | 81 | 83 | 87 | 92 | 92 | |
| T-GEMs + JumperLoss=Lr + Ls, SF=class-rate, AP=362k, Backbone=ViT-B-322026.05 | 89 | 38 | 44 | 48 | 48 | 60 | 62 | 79 | 78 | 84 | 89 | 83 | |
| T-GEMs + JumperLoss=Lr + Ls, SF=Cosine, AP=592k, Backbone=ViT-L-142026.05 | 84 | 48 | 52 | 53 | 54 | 55 | 64 | 66 | 70 | 71 | 77 | 79 | |
| JumperLoss=Ls, SF=Cosine, AP=230k, Backbone=ViT-L-142026.05 | 83 | 46 | 51 | 54 | 55 | 54 | 60 | 65 | 69 | 71 | 78 | 78 | |
| Sampling-basedLoss=-, SF=class-rate, AP=0, Backbone=ViT-B-322026.05 | 82 | 27 | 32 | 37 | 41 | 48 | 57 | 61 | 65 | 77 | 85 | 83 | |
| T-GEMs + JumperLoss=Lr + Ls, SF=class-rate, AP=592k, Backbone=ViT-L-142026.05 | 77 | 40 | 42 | 47 | 49 | 46 | 53 | 56 | 62 | 62 | 67 | 67 | |
| Sampling-basedLoss=-, SF=Cosine, AP=0, Backbone=ViT-B-322026.05 | 76 | 29 | 30 | 33 | 37 | 42 | 50 | 57 | 62 | 70 | 76 | 71 | |
| Sampling-basedLoss=-, SF=Cosine, AP=0, Backbone=ViT-L-142026.05 | 58 | 24 | 25 | 29 | 30 | 31 | 33 | 36 | 38 | 43 | 48 | 54 | |
| Sampling-basedLoss=-, SF=class-rate, AP=0, Backbone=ViT-L-142026.05 | 56 | 20 | 25 | 26 | 30 | 35 | 36 | 38 | 41 | 43 | 48 | 54 | |
| T-GEMs + JumperLoss=Lr, SF=class-rate, AP=362k, Backbone=ViT-B-322026.05 | 54 | 14 | 18 | 13 | 16 | 18 | 26 | 35 | 43 | 48 | 54 | 53 | |
| T-GEMs + JumperLoss=Lr, SF=class-rate, AP=592k, Backbone=ViT-L-142026.05 | 51 | 36 | 34 | 38 | 38 | 41 | 43 | 41 | 49 | 45 | 48 | 65 |