Image Classification on VTAB
91.97Overall AccuracyFull-Tune
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Full-TuneArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=304.33, Memory=41.5, Time=520, Throughput=79.582026.04 | 91.97 | — | — | — | — | — | |
| Full-TuneBackbone=ViT-Large/16, Data Setting=Full-Data, Param. #=304.33, Memory=41.5, Time=520, Throughput=79.582026.04 | 91.97 | — | — | — | — | — | |
| AdapterFormerArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=0.65, Memory=32.3, Time=289, Throughput=23.692026.04 | 90.69 | — | — | — | — | — | |
| AdapterFormerBackbone=ViT-Large/16, Data Setting=Full-Data, Param. #=0.65, Memory=32.3, Time=289, Throughput=23.692026.04 | 90.69 | — | — | — | — | — | |
| APArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=0.16, Memory=31.6, Time=262, Throughput=79.432026.04 | 90.25 | — | — | — | — | — | |
| APBackbone=ViT-Large/16, Data Setting=Full-Data, Param. #=0.16, Memory=31.6, Time=262, Throughput=79.432026.04 | 90.25 | — | — | — | — | — | |
| E2VPTArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=1.21, Memory=33.4, Time=369, Throughput=52.322026.04 | 90.12 | — | — | — | — | — | |
| VPTBackbone=ViT-Large/16, Data Setting=Full-Data, Param. #=1.24, Memory=38.6, Time=397, Throughput=72.842026.04 | 89.97 | — | — | — | — | — | |
| BiasArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=0.29, Memory=32.9, Time=297, Throughput=79.432026.04 | 89.84 | — | — | — | — | — | |
| BiasBackbone=ViT-Large/16, Data Setting=Full-Data, Param. #=0.29, Memory=32.9, Time=297, Throughput=79.482026.04 | 89.84 | — | — | — | — | — | |
| LoRAArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=1.00, Memory=33.1, Time=363, Throughput=79.432026.04 | 89.81 | — | — | — | — | — | |
| LoRABackbone=ViT-Large/16, Data Setting=Full-Data, Param. #=1.00, Memory=33.1, Time=363, Throughput=79.432026.04 | 89.81 | — | — | — | — | — | |
| AdapterArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=2.17, Memory=32.4, Time=357, Throughput=63.392026.04 | 89.44 | — | — | — | — | — | |
| AdapterBackbone=ViT-Large/16, Data Setting=Full-Data, Param. #=2.17, Memory=32.4, Time=357, Throughput=63.392026.04 | 89.44 | — | — | — | — | — | |
| SSFArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=0.48, Memory=34.7, Time=299, Throughput=79.492026.04 | 89.43 | — | — | — | — | — | |
| SSFBackbone=ViT-Large/16, Data Setting=Full-Data, Param. #=0.48, Memory=34.7, Time=299, Throughput=79.492026.04 | 89.43 | — | — | — | — | — | |
| VPTArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=0.25, Memory=33.7, Time=334, Throughput=76.352026.04 | 89.24 | — | — | — | — | — | |
| GateVPTArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=3.14, Memory=34.9, Time=395, Throughput=61.342026.04 | 89.14 | — | — | — | — | — | |
| Linear-ProbeArchitecture=ViT-L/16, Data Setting=Full-Data, Param. #=0.01, Memory=9.7, Time=121, Throughput=79.642026.04 | 78.9 | — | — | — | — | — | |
| Linear-ProbeBackbone=ViT-Large/16, Data Setting=Full-Data, Param. #=0.01, Memory=9.7, Time=121, Throughput=79.642026.04 | 78.9 | — | — | — | — | — | |
| FrancaArch=ViT-L/14, Probe=X-Blk2026.03 | 72.1 | 78.6 | 84.5 | 60.1 | — | — | |
| DINOv2 (dst)Arch=ViT-L/14, Probe=X-Blk2026.03 | 71.2 | 79.6 | 84.7 | 57 | — | — | |
| DINOv2 (dst)Arch=ViT-B/14, Probe=X-Blk2026.03 | 71.1 | 78.1 | 84.2 | 58.3 | — | — | |
| CAPIArch=ViT-L/14, Probe=X-Blk2026.03 | 70.9 | 72.7 | 83.5 | 63.1 | — | — | |
| FrancaArch=ViT-B/14, Probe=X-Blk2026.03 | 69.3 | 75.1 | 83.3 | 57.3 | — | — | |
| DINOv2 (dst)Arch=ViT-S/14, Probe=X-Blk2026.03 | 69.1 | 74.1 | 83 | 57.7 | — | — | |
| BootlegArch=ViT-L/16, Probe=X-Blk2026.03 | 68.7 | 70.9 | 84.2 | 58.9 | — | — | |
| MAEArch=ViT-L/16, Probe=X-Blk2026.03 | 67.5 | 65.7 | 81.6 | 62.1 | — | — | |
| CrossMAEArch=ViT-B/16, Probe=X-Blk2026.03 | 67.3 | 65.8 | 81 | 61.8 | — | — | |
| BootlegArch=ViT-B/16, Probe=X-Blk2026.03 | 67 | 68 | 83.7 | 57.8 | — | — | |
| MAEArch=ViT-B/16, Probe=X-Blk2026.03 | 65.1 | 64.4 | 79.2 | 58.7 | — | — | |
| CrossMAEArch=ViT-L/16, Probe=X-Blk2026.03 | 65.1 | 68.4 | 81.4 | 54.1 | — | — | |
| data2vec 2.0Arch=ViT-L/16, Probe=X-Blk2026.03 | 63.6 | 55.5 | 80.1 | 62.5 | — | — | |
| BootlegArch=ViT-S/16, Probe=X-Blk2026.03 | 63.5 | 66.2 | 80.8 | 52.5 | — | — | |
| CrossMAEArch=ViT-S/16, Probe=X-Blk2026.03 | 62.8 | 59.7 | 78.8 | 57.5 | — | — | |
| DINOv2 (dst)Arch=ViT-L/14, Probe=Patch2026.03 | 62.4 | 72.9 | 83.8 | 42.5 | — | — | |
| DINOv2 (dst)Arch=ViT-B/14, Probe=Patch2026.03 | 61.8 | 72.8 | 83.1 | 41.3 | — | — | |
| DINOv2 (dst)Arch=ViT-L/14, Probe=CLS2026.03 | 61.5 | 75.5 | 84.4 | 37.7 | — | — | |
| DINOv2 (dst)Arch=ViT-B/14, Probe=CLS2026.03 | 60.3 | 74.6 | 81.7 | 37.2 | — | — | |
| MAEArch=ViT-S/16, Probe=X-Blk2026.03 | 60.1 | 57.6 | 78.2 | 53.2 | — | — | |
| FrancaArch=ViT-L/14, Probe=Patch2026.03 | 59.9 | 71.2 | 82.2 | 38.9 | — | — | |
| DINOv2 (dst)Arch=ViT-S/14, Probe=Patch2026.03 | 59.1 | 69 | 81.6 | 39.3 | — | — | |
| DINOv2 (dst)Arch=ViT-S/14, Probe=CLS2026.03 | 59 | 72.1 | 81.1 | 36.4 | — | — | |
| CAPIArch=ViT-L/14, Probe=Patch2026.03 | 58.9 | 62.4 | 80.8 | 44.9 | — | — | |
| UpperCaSEProtocol=hybrid, Net=EfficientNet-B0, Img Size=224, Param. (M)=4.0, Adaptive Param Count (M)=0.42022.06 | 58.4 | 69.1 | 80.3 | 39.4 | — | — | |
| FrancaArch=ViT-B/14, Probe=Patch2026.03 | 58.1 | 66.5 | 82.1 | 38.6 | — | — | |
| data2vec 2.0Arch=ViT-B/16, Probe=X-Blk2026.03 | 58 | 54.6 | 72.4 | 53.8 | — | — | |
| MAEArch=ViT-L/16, Probe=CLS2026.03 | 57.9 | 60.1 | 80.2 | 44.7 | — | — | |
| I-JEPAArch=ViT-B/16, Probe=X-Blk2026.03 | 57.8 | 55.1 | 78.5 | 49.8 | — | — | |
| CrossMAEArch=ViT-L/16, Probe=CLS2026.03 | 57.8 | 57.6 | 80.5 | 46.5 | — | — | |
| CrossMAEArch=ViT-L/16, Probe=Patch2026.03 | 57.7 | 59.1 | 78.8 | 46 | — | — | |
| I-JEPAArch=ViT-L/16, Probe=X-Blk2026.03 | 57.5 | 58 | 79.1 | 46.3 | — | — | |
| BootlegArch=ViT-L/16, Probe=CLS2026.03 | 57.4 | 64.9 | 79.7 | 39.7 | — | — | |
| BootlegArch=ViT-L/16, Probe=Patch2026.03 | 57.1 | 60.7 | 81.9 | 41.5 | — | — | |
| FrancaArch=ViT-B/14, Probe=CLS2026.03 | 56.9 | 71.3 | 79.7 | 32.8 | — | — | |
| UpperCaSEProtocol=hybrid, Net=ResNet-50, Img Size=224, Param. (M)=23.5, Adaptive Param Count (M)=0.82022.06 | 56.6 | 66.3 | 80.1 | 37.6 | — | — | |
| MAEArch=ViT-L/16, Probe=Patch2026.03 | 56.6 | 56.2 | 79.4 | 45.4 | — | — | |
| data2vec 2.0Arch=ViT-S/16, Probe=X-Blk2026.03 | 56.5 | 48.4 | 74.1 | 54.7 | — | — | |
| CrossMAEArch=ViT-B/16, Probe=Patch2026.03 | 56.4 | 56.4 | 77.6 | 45.7 | — | — | |
| BootlegArch=ViT-B/16, Probe=Patch2026.03 | 56.4 | 60.7 | 82.1 | 39.8 | — | — | |
| BootlegArch=ViT-S/16, Probe=Patch2026.03 | 55.6 | 59.8 | 79 | 40.4 | — | — | |
| BootlegArch=ViT-B/16, Probe=CLS2026.03 | 55.6 | 61.5 | 80.5 | 38 | — | — | |
| FrancaArch=ViT-L/14, Probe=CLS2026.03 | 55.5 | 68.7 | 78.9 | 32.2 | — | — | |
| data2vec 2.0Arch=ViT-L/16, Probe=Patch2026.03 | 55 | 51.9 | 77.8 | 46.3 | — | — | |
| BootlegArch=ViT-S/16, Probe=CLS2026.03 | 54.9 | 59.8 | 78.1 | 38.9 | — | — | |
| CrossMAEArch=ViT-B/16, Probe=CLS2026.03 | 54.8 | 55.2 | 74.3 | 44.7 | — | — | |
| MAEArch=ViT-B/16, Probe=Patch2026.03 | 53.9 | 54.3 | 76.7 | 42.2 | — | — | |
| data2vec 2.0Arch=ViT-B/16, Probe=Patch2026.03 | 53.9 | 52.6 | 76.6 | 43.7 | — | — | |
| MAEArch=ViT-B/16, Probe=CLS2026.03 | 53.6 | 53.4 | 76.8 | 42.2 | — | — | |
| data2vec 2.0Arch=ViT-L/16, Probe=CLS2026.03 | 52.8 | 47.9 | 74 | 46.5 | — | — | |
| I-JEPAArch=ViT-L/16, Probe=Patch2026.03 | 52.4 | 54 | 78.4 | 38 | — | — | |
| I-JEPAArch=ViT-B/16, Probe=Patch2026.03 | 51.6 | 50.4 | 77.2 | 39.8 | — | — | |
| LITEProtocol=meta-learning, Net=EfficientNet-B0, Img Size=224, Param. (M)=4.0, Adaptive Param Count (M)=1.72022.06 | 51.4 | 65.2 | 71.9 | 30.8 | — | — | |
| CrossMAEArch=ViT-S/16, Probe=Patch2026.03 | 51.3 | 47.9 | 77.4 | 41.2 | — | — | |
| I-JEPAArch=ViT-S/16, Probe=X-Blk2026.03 | 50.9 | 45.8 | 73.8 | 43.9 | — | — | |
| CTXProtocol=meta-learning, Net=ResNet-34, Img Size=224, Param. (M)=21.32022.06 | 50.5 | 61.1 | 67.3 | 34 | — | — | |
| data2vec 2.0Arch=ViT-B/16, Probe=CLS2026.03 | 50.2 | 43.9 | 71.6 | 44.9 | — | — | |
| CrossMAEArch=ViT-S/16, Probe=CLS2026.03 | 50.1 | 46.4 | 76 | 40.2 | — | — | |
| MAEArch=ViT-S/16, Probe=CLS2026.03 | 49.7 | 46.2 | 77.3 | 38.9 | — | — | |
| MAEArch=ViT-S/16, Probe=Patch2026.03 | 49.5 | 45.7 | 76.6 | 39.1 | — | — | |
| data2vec 2.0Arch=ViT-S/16, Probe=Patch2026.03 | 46.9 | 38.8 | 74.6 | 40.1 | — | — | |
| I-JEPAArch=ViT-S/16, Probe=Patch2026.03 | 46.3 | 40.2 | 74.3 | 37.7 | — | — | |
| ProtoNetProtocol=meta-learning, Net=EfficientNet-B0, Img Size=224, Param. (M)=4.02022.06 | 46.1 | 60.9 | 64.2 | 25.9 | — | — | |
| data2vec 2.0Arch=ViT-S/16, Probe=CLS2026.03 | 45.8 | 37.4 | 75.6 | 38.4 | — | — | |
| ProtoMAMLProtocol=hybrid, Net=ResNet-18, Img Size=126, Param. (M)=11.22022.06 | 45 | 45.7 | 70.7 | 31.5 | — | — | |
| DFN ∪ Ours (20%)*Type=D3, Dataset Size=23M2024.05 | 38.6 | — | — | — | — | — | |
| DFN ∪ HYPEType=D3, Dataset Size=20M2024.05 | 38.5 | — | — | — | — | — | |
| DFN ∪ HYPE ∪ Ours (10%)*Type=D3, Dataset Size=22M2024.05 | 38.5 | — | — | — | — | — | |
| DFNType=D2, Dataset Size=16M2024.05 | 36.2 | — | — | — | — | — | |
| MLMType=D3, Dataset Size=38M2024.05 | 36 | — | — | — | — | — | |
| DevilType=D3, Dataset Size=20M2024.05 | 35.9 | — | — | — | — | — | |
| Ours (20%)Type=D1, Dataset Size=22M2024.05 | 35.9 | — | — | — | — | — | |
| T-MARSType=D3, Dataset Size=22M2024.05 | 34.8 | — | — | — | — | — | |
| HYPEType=D3, Dataset Size=10M2024.05 | 34.3 | — | — | — | — | — | |
| TripletCLIPTraining Dataset=CC12M, Evaluation Protocol=Zero-shot, Backbone=ViT-B/322024.11 | 20.81 | — | — | — | 53.4 | — | |
| Self-Filtering 40%Backbone=ViT-B/32, Data=40% subset selected via Self-Filtering, Evaluation Protocol=Zero-shot2026.06 | 19.7 | — | — | — | — | — | |
| CLIP with OAI CLIP Filtered data + AllBackbone=ViT-B/32, Data=OAI Filtered + All data mix, Evaluation Protocol=Zero-shot2026.06 | 19.6 | — | — | — | — | — | |
| NegCLIPTraining Dataset=CC12M, Evaluation Protocol=Zero-shot, Backbone=ViT-B/322024.11 | 19.12 | — | — | — | 50.56 | — | |
| Final Self-Filtered 30% Data MixBackbone=ViT-B/32, Data=Final data mix from last round of Self-Filtering, Evaluation Protocol=Zero-shot2026.06 | 19.1 | — | — | — | — | — | |
| LaCLIPTraining Dataset=CC12M, Evaluation Protocol=Zero-shot, Backbone=ViT-B/322024.11 | 19.08 | — | — | — | 49.06 | — |