Zero-shot Retrieval on MSCOCO
31I→T RetrievalDeRS-LM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DeRS-LMBackbone=ViT-B/32, Evaluation=Zero-shot2026.04 | 31 | 47.7 | 39.4 | |
| Cluster-aware UpcyclingBackbone=ViT-B/32, Evaluation=Zero-shot2026.04 | 31 | 48.2 | 39.6 | |
| Sparse UpcyclingBackbone=ViT-B/32, Evaluation=Zero-shot2026.04 | 30.8 | 48 | 39.4 | |
| Drop-SVDBackbone=ViT-B/32, Evaluation=Zero-shot2026.04 | 30.7 | 47.9 | 39.3 | |
| Drop-UpcyclingBackbone=ViT-B/32, r=0.25, Evaluation=Zero-shot2026.04 | 30.6 | 47.6 | 39.1 | |
| Drop-UpcyclingBackbone=ViT-B/32, r=0.50, Evaluation=Zero-shot2026.04 | 29.7 | 46.5 | 38.1 | |
| CLIP-MoEBackbone=ViT-B/32, Evaluation=Zero-shot2026.04 | 29.5 | 46.8 | 38.2 | |
| Drop-UpcyclingBackbone=ViT-B/32, r=0.75, Evaluation=Zero-shot2026.04 | 29.1 | 45.6 | 37.4 |