Image Classification on EuroSAT (16-shot)
91.3Accuracyglass-box
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| glass-boxService Model=LLaVA2026.04 | 91.3 | — | — | — | — | |
| VR (glass-box)Backbone=CLIP ViT-B/16 (Service), Shot Setting=16-shot, #API (M)=16.82, Time (h)=9.82026.04 | 90.9 | — | — | — | — | |
| AReSService Model=GPT-4o2026.04 | 87.2 | 0.3 | 0 | — | 0.3 | |
| AReSBackbone=ViT-B/16 (Local), Shot Setting=16-shot, #API (M)=0.02, Time (h)=3.72026.04 | 85.7 | — | — | — | — | |
| AReS-MSBackbone=Service & Local selection, Shot Setting=16-shot, #API (M)=0.06, Time (h)=3.72026.04 | 85.7 | — | — | — | — | |
| AReSService Model=Clarifai2026.04 | 83.2 | 0.2 | 0 | — | 0.2 | |
| BARBackbone=CLIP ViT-B/16 (Service), Shot Setting=16-shot, #API (M)=612.84, Time (h)=185.62026.04 | 77.3 | — | — | — | — | |
| BlackVIPBackbone=CLIP ViT-B/16 (Service), Shot Setting=16-shot, #API (M)=754.20, Time (h)=197.52026.04 | 73.3 | — | — | — | — | |
| AReSService Model=LLaVA2026.04 | 73.1 | 160 | 0 | 160 | — | |
| BlackVIPService Model=Clarifai2026.04 | 72.1 | 57.6 | 9.7 | — | 67.3 | |
| BARService Model=Clarifai2026.04 | 68.1 | 38.4 | 9.7 | — | 48.1 | |
| BlackVIPService Model=GPT-4o2026.04 | 60.1 | 86.4 | 14.6 | — | 101 | |
| Zero-shotService Model=GPT-4o2026.04 | 59.4 | — | 14.6 | — | 14.6 | |
| BARService Model=GPT-4o2026.04 | 59.1 | 57.6 | 14.6 | — | 72.2 | |
| LLM-OptBackbone=CLIP ViT-B/16 (Service), Shot Setting=16-shot, #API (M)=5011.32, Time (h)=5.12026.04 | 48 | — | — | — | — | |
| Zero-shotBackbone=CLIP ViT-B/16 (Service), Shot Setting=16-shot, #API (M)=0.12, Time (h)=02026.04 | 47.9 | — | — | — | — | |
| Zero-shotService Model=LLaVA2026.04 | 40.1 | — | 8,100 | 8,100 | — | |
| BlackVIPService Model=LLaVA2026.04 | 39.4 | 10 | 8,100 | 10 | — | |
| BARService Model=LLaVA2026.04 | 34.1 | 10 | 8,100 | 10 | — |