Image Classification on SUN397 (16-shot)
66.7AccuracyVR (glass-box)
Evaluation Results
| Method | Links | |
|---|---|---|
| VR (glass-box)Backbone=CLIP ViT-B/16 (Service), Shot Setting=16-shot, #API (M)=16.82, Time (h)=9.82026.04 | 66.7 | |
| BlackVIPBackbone=CLIP ViT-B/16 (Service), Shot Setting=16-shot, #API (M)=754.20, Time (h)=197.52026.04 | 64.5 | |
| AReSBackbone=ViT-B/16 (Local), Shot Setting=16-shot, #API (M)=0.02, Time (h)=3.72026.04 | 62.8 | |
| AReS-MSBackbone=Service & Local selection, Shot Setting=16-shot, #API (M)=0.06, Time (h)=3.72026.04 | 62.8 | |
| Zero-shotBackbone=CLIP ViT-B/16 (Service), Shot Setting=16-shot, #API (M)=0.12, Time (h)=02026.04 | 62.6 | |
| BARBackbone=CLIP ViT-B/16 (Service), Shot Setting=16-shot, #API (M)=612.84, Time (h)=185.62026.04 | 62.4 | |
| LLM-OptBackbone=CLIP ViT-B/16 (Service), Shot Setting=16-shot, #API (M)=5011.32, Time (h)=5.12026.04 | 60.3 |