Image Classification on Oxford Pets (test)
99.36AccuracySDFed
Evaluation results
| Method | Links | |
|---|---|---|
| SDFedBackbone=ViT-B162026.02 | 99.36 | |
| UOPPBackbone=ViT-B162026.02 | 98.71 | |
| FedOTPBackbone=ViT-B162026.02 | 97.54 | |
| GPT-FLBackbone=ViT-B162026.02 | 97.38 | |
| SDFedBackbone=ResNet502026.02 | 96.54 | |
| BiFTABackbone=ViT-L/14, Zero-shot=true2026.01 | 94.96 | |
| UOPPBackbone=ResNet502026.02 | 94.82 | |
| WCABackbone=ViT-L/14, Zero-shot=true2026.01 | 94.67 | |
| CuPLBackbone=ViT-L/14, Zero-shot=true2026.01 | 94.33 | |
| PowderBackbone=ViT-B162026.02 | 93.76 | |
| GPT-FLBackbone=ResNet502026.02 | 93.67 | |
| CLIP-EBackbone=ViT-L/14, Zero-shot=true2026.01 | 93.62 | |
| CoOpBackbone=ViT-B162026.02 | 93.41 | |
| Gemini2.0-Flash-Lite# Params=n/a, Setting=Zero-shot2026.02 | 93.32 | |
| CLIP-DBackbone=ViT-L/14, Zero-shot=true2026.01 | 93.3 | |
| CLIPBackbone=ViT-L/14, Zero-shot=true2026.01 | 93.24 | |
| Calibration w/ ADAMAB# Params=+0.664M, Setting=Zero-shot, Backbone=CLIP-ViT-Large2026.02 | 93.2 | |
| FedOTPBackbone=ResNet502026.02 | 92.45 | |
| Calibration w/ random aug.# Params=+0.664M, Setting=Zero-shot, Backbone=CLIP-ViT-Large2026.02 | 91.9 | |
| WaffleBackbone=ViT-L/14, Zero-shot=true2026.01 | 91.55 | |
| Calibration w/ only init set# Params=+0.664M, Setting=Zero-shot, Backbone=CLIP-ViT-Large2026.02 | 90.95 | |
| PowderBackbone=ResNet502026.02 | 89.15 | |
| DEFTNoise rate=12.5%2026.03 | 88.83 | |
| CoOpBackbone=ResNet502026.02 | 88.52 | |
| NA-MVPNoise rate=12.5%2026.03 | 88.5 | |
| NA-MVPNoise rate=25%2026.03 | 88.4 | |
| DEFTNoise rate=25%2026.03 | 88.23 | |
| NA-MVPNoise rate=37.5%2026.03 | 88.23 | |
| NA-MVPNoise rate=50%2026.03 | 88.13 | |
| DEFTNoise rate=37.5%2026.03 | 88.1 | |
| RCgamma_c=0.50, prompt-mode=cls-prompts2026.04 | 87.8 | |
| NA-MVPNoise rate=62.5%2026.03 | 86.93 | |
| DEFTNoise rate=50%2026.03 | 86.73 | |
| Calibration w/ ADAMAB# Params=+1.180M, Setting=Zero-shot, Backbone=Voyage-multimodal-32026.02 | 86.34 | |
| NA-MVPNoise rate=75%2026.03 | 86.23 | |
| Calibration w/ random aug.# Params=+1.180M, Setting=Zero-shot, Backbone=Voyage-multimodal-32026.02 | 85.05 | |
| RCgamma_c=0.75, prompt-mode=cls-prompts2026.04 | 84.8 | |
| RCgamma_c=0.80, prompt-mode=cls-prompts2026.04 | 84.7 | |
| DEFTNoise rate=62.5%2026.03 | 84.1 | |
| APArchitecture=CLIP (ViT-B/32)2026.04 | 83.82 | |
| HopSrandom confusion rate (gamma_c)=0.75, prompting=uni-prompt2026.04 | 83.8 | |
| HopSrandom confusion rate (gamma_c)=0.50, prompting=uni-prompt2026.04 | 83.5 | |
| CLIP-ViT-Large# Params=0.4B, Setting=Zero-shot2026.02 | 82.88 | |
| HopSrandom confusion rate (gamma_c)=0.80, prompting=uni-prompt2026.04 | 82.6 | |
| APArchitecture=Swin-Transformer (Swin-B)2026.04 | 82.29 | |
| VPArchitecture=CLIP (ViT-B/32)2026.04 | 81.97 | |
| HopSgamma_c=0.50, prompt-mode=cls-prompts2026.04 | 81.1 | |
| CCgamma_c=0.50, prompt-mode=cls-prompts2026.04 | 81 | |
| RCgamma_c=0.88, prompt-mode=cls-prompts2026.04 | 80.8 | |
| HopSgamma_c=0.75, prompt-mode=cls-prompts2026.04 | 80.5 | |
| HopSrandom confusion rate (gamma_c)=0.90, prompting=uni-prompt2026.04 | 80.5 | |
| VPArchitecture=Swin-Transformer (Swin-B)2026.04 | 80.42 | |
| CCgamma_c=0.75, prompt-mode=cls-prompts2026.04 | 80.3 | |
| HopSrandom confusion rate (gamma_c)=0.88, prompting=uni-prompt2026.04 | 79.9 | |
| GPT-4o-mini# Params=n/a, Setting=Zero-shot2026.02 | 79.83 | |
| HopSgamma_c=0.80, prompt-mode=cls-prompts2026.04 | 79.2 | |
| Llama-3.2# Params=90B, Setting=Zero-shot2026.02 | 78.64 | |
| SCEgamma_c=0.50, prompt-mode=cls-prompts2026.04 | 77.5 | |
| RCgamma_c=0.90, prompt-mode=cls-prompts2026.04 | 76.3 | |
| DEFTNoise rate=75%2026.03 | 75.87 | |
| Calibration w/ only init set# Params=+1.180M, Setting=Zero-shot, Backbone=Voyage-multimodal-32026.02 | 74.68 | |
| SCEgamma_c=0.75, prompt-mode=cls-prompts2026.04 | 73.9 | |
| CCgamma_c=0.80, prompt-mode=cls-prompts2026.04 | 73.9 | |
| Jina-reranker-m0# Params=2.4B, Setting=Zero-shot2026.02 | 73.64 | |
| HopSgamma_c=0.88, prompt-mode=cls-prompts2026.04 | 71.9 | |
| SCEgamma_c=0.80, prompt-mode=cls-prompts2026.04 | 71.8 | |
| MSEgamma_c=0.50, prompt-mode=cls-prompts2026.04 | 71.7 | |
| LWCgamma_c=0.50, prompt-mode=cls-prompts2026.04 | 71 | |
| HopSgamma_c=0.90, prompt-mode=cls-prompts2026.04 | 70.2 | |
| Voyage-multimodal-3# Params=n/a, Setting=Zero-shot2026.02 | 67.45 | |
| CCgamma_c=0.88, prompt-mode=cls-prompts2026.04 | 67.2 | |
| SCEgamma_c=0.88, prompt-mode=cls-prompts2026.04 | 67.2 | |
| MSEgamma_c=0.75, prompt-mode=cls-prompts2026.04 | 64.4 | |
| SCEgamma_c=0.90, prompt-mode=cls-prompts2026.04 | 63.8 | |
| MSEgamma_c=0.80, prompt-mode=cls-prompts2026.04 | 63.4 | |
| LWCgamma_c=0.75, prompt-mode=cls-prompts2026.04 | 62 | |
| Mistral-Small# Params=24B, Setting=Zero-shot2026.02 | 61.22 | |
| HopSBackbone (Insd)=ResNet-18, Insd confusion rate (γc)=0.67, Prompting (uni-prompt)=true2026.04 | 59.1 | |
| HopSBackbone (Insd)=CLIP-ResNet50, Insd confusion rate (γc)=0.67, Prompting (uni-prompt)=true2026.04 | 58.5 | |
| EXPgamma_c=0.50, prompt-mode=cls-prompts2026.04 | 57.3 | |
| Prototypical CurriculumShot=5-shot, Protocol=linear probing, Training epochs=4002024.11 | 56.97 | |
| LWCgamma_c=0.80, prompt-mode=cls-prompts2026.04 | 56.9 | |
| HopSBackbone (Insd)=ResNet-18, Insd confusion rate (γc)=0.75, Prompting (uni-prompt)=true2026.04 | 55.6 | |
| HopSBackbone=ResNet-18, Confusion rate=0.80, Prompt type=uni-prompt2026.04 | 55.6 | |
| EXPgamma_c=0.75, prompt-mode=cls-prompts2026.04 | 54 | |
| HopSBackbone (Insd)=ResNet-50, Insd confusion rate (γc)=0.67, Prompting (uni-prompt)=true2026.04 | 53.3 | |
| CCgamma_c=0.90, prompt-mode=cls-prompts2026.04 | 52.2 | |
| HopSBackbone (Insd)=ResNet-50, Insd confusion rate (γc)=0.75, Prompting (uni-prompt)=true2026.04 | 51.8 | |
| HopSBackbone=ResNet-50, Confusion rate=0.80, Prompt type=uni-prompt2026.04 | 51.5 | |
| HopSBackbone (Insd)=CLIP-ResNet50, Insd confusion rate (γc)=0.75, Prompting (uni-prompt)=true2026.04 | 50.3 | |
| HopSBackbone=CLIP-ResNet50, Confusion rate=0.80, Prompt type=uni-prompt2026.04 | 48.8 | |
| MSEgamma_c=0.88, prompt-mode=cls-prompts2026.04 | 47.6 | |
| CEBackbone=ResNet-18, Confusion rate=0.80, Prompt type=uni-prompt2026.04 | 47.5 | |
| LWCBackbone=ResNet-18, Confusion rate=0.80, Prompt type=uni-prompt2026.04 | 47 | |
| GCEgamma_c=0.50, prompt-mode=cls-prompts2026.04 | 45.8 | |
| MAEgamma_c=0.50, prompt-mode=cls-prompts2026.04 | 45.1 | |
| LWCBackbone=ResNet-50, Confusion rate=0.80, Prompt type=uni-prompt2026.04 | 45 | |
| LWCBackbone=CLIP-ResNet50, Confusion rate=0.80, Prompt type=uni-prompt2026.04 | 44.7 | |
| CEBackbone=ResNet-50, Confusion rate=0.80, Prompt type=uni-prompt2026.04 | 44.6 | |
| EXPgamma_c=0.80, prompt-mode=cls-prompts2026.04 | 44.5 |