Multi-label Classification on NUS-WIDE (925/81 unseen)
53.2mAP (Mean Average Precision)RAM
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| RAMBackbone=ViT-B/162025.03 | 53.2 | 43.7 | 54.2 | 48.4 | 33.8 | 69.9 | 45.6 | |
| COMCBackbone=ViT-B/162025.03 | 48.2 | 33.5 | 53.5 | 41.2 | 24.8 | 66.1 | 36.1 | |
| DualCoOp++Backbone=ViT-B/162025.03 | 47.1 | 42.4 | 52.5 | 46.9 | 31.2 | 64.5 | 42.1 | |
| DualCoop#P=0.02M2022.06 | 43.6 | 37.3 | 46.2 | 41.3 | 28.7 | 59.3 | 38.7 | |
| DualCoOpBackbone=ViT-B/162025.03 | 43.6 | 37.3 | 46.2 | 41.3 | 28.7 | 59.3 | 38.7 | |
| OVMLBackbone=ViT-B/162025.03 | 42.6 | 36.3 | 44.7 | 40.1 | 27.9 | 57.2 | 37.5 | |
| CLIPBackbone=ViT-B/162025.03 | 39.4 | 33.5 | 41.6 | 37.1 | 25.1 | 51.8 | 33.8 | |
| MKTBackbone=ViT-B/162025.03 | 37.6 | 27.7 | 44.3 | 34.1 | 21.4 | 57 | 31.1 | |
| ML-DecoderTask=ZSL2021.11 | 31.1 | — | — | 34.1 | — | — | 30.8 | |
| TGFBackbone=ViT-B/162025.03 | 31.1 | 29 | 46.3 | 35.6 | 21.4 | 56.9 | 31.1 | |
| BIAMTask=ZSL2021.11 | 26.3 | — | — | 33.1 | — | — | 30.7 | |
| BIAMBackbone=ViT-B/162025.03 | 26.3 | — | — | 33.1 | — | — | 30.7 | |
| BIAM#P=3.8M2022.06 | 26.2 | — | — | 33.1 | — | — | 30.7 | |
| SDLTask=ZSL2021.11 | 25.9 | — | — | 30.5 | — | — | 27.8 | |
| SDL (M=7)#P=33.6M2022.06 | 25.9 | 24.2 | 41.3 | 30.5 | 18.8 | 53.4 | 27.8 | |
| SDLMBackbone=ViT-B/162025.03 | 25.9 | 24.2 | 41.3 | 30.5 | 18.8 | 53.4 | 27.8 | |
| ML-DecoderTask=GZSL2021.11 | 19.9 | — | — | 23.3 | — | — | 26.1 | |
| LESATask=ZSL2021.11 | 19.4 | — | — | 31.6 | — | — | 28.7 | |
| LESA (M=10)#P=≥ 0.45M2022.06 | 19.4 | 25.7 | 41.1 | 31.6 | 19.7 | 52.5 | 28.7 | |
| LESAMBackbone=ViT-B/162025.03 | 19.4 | 25.7 | 41.1 | 31.6 | 19.7 | 52.5 | 28.7 | |
| FastTagTask=ZSL2021.11 | 15.1 | — | — | 27.8 | — | — | 26.4 | |
| FastTag#P=0.61M2022.06 | 15.1 | 22.6 | 36.2 | 27.8 | 18.2 | 48.4 | 26.4 | |
| Attention per ClusterTask=ZSL2021.11 | 12.9 | — | — | 24.6 | — | — | 22.9 | |
| SDLTask=GZSL2021.11 | 12.1 | — | — | 18.5 | — | — | 21 | |
| SDL (M=7)#P=33.6M2022.06 | 12.1 | 27.7 | 13.9 | 18.5 | 23 | 19.3 | 21 | |
| DualCoop#P=0.02M2022.06 | 12 | 31.9 | 13.9 | 19.4 | 26.2 | 19.1 | 22.1 | |
| Attention per LabelTask=ZSL2021.11 | 10.4 | — | — | 25.8 | — | — | 23.6 | |
| One Attention per Label#P=≥ 12.8M2022.06 | 10.4 | 20.9 | 33.5 | 25.8 | 16.2 | 43.2 | 23.6 | |
| CONSETask=ZSL2021.11 | 9.4 | — | — | 21.6 | — | — | 20.2 | |
| CONSE2022.06 | 9.4 | 17.5 | 28 | 21.6 | 13.9 | 37 | 20.2 | |
| BIAMTask=GZSL2021.11 | 9.3 | — | — | 16.1 | — | — | 19 | |
| BIAM#P=3.8M2022.06 | 9.3 | — | — | 16.1 | — | — | 19 | |
| LabelEM2022.06 | 7.1 | 15.6 | 25 | 19.2 | 13.4 | 35.7 | 19.5 | |
| LESATask=GZSL2021.11 | 5.6 | — | — | 14.4 | — | — | 16.8 | |
| LESA (M=10)#P=≥ 0.45M2022.06 | 5.6 | 23.6 | 10.4 | 14.4 | 19.8 | 14.6 | 16.8 | |
| FastTagTask=GZSL2021.11 | 3.7 | — | — | 11.5 | — | — | 13.5 | |
| Attention per LabelTask=GZSL2021.11 | 3.7 | — | — | 10.9 | — | — | 13.2 | |
| FastTag#P=0.61M2022.06 | 3.7 | 18.8 | 8.3 | 11.5 | 15.9 | 11.7 | 13.5 | |
| One Attention per Label#P=≥ 12.8M2022.06 | 3.7 | 17.9 | 7.9 | 10.9 | 15.6 | 11.5 | 13.2 | |
| Attention per ClusterTask=GZSL2021.11 | 2.6 | — | — | 6.4 | — | — | 7.7 | |
| LabelEM2022.06 | 2.2 | 15.5 | 6.8 | 9.5 | 13.4 | 9.8 | 11.3 | |
| CONSETask=GZSL2021.11 | 2.1 | — | — | 7 | — | — | 8.1 | |
| CONSE2022.06 | 2.1 | 11.5 | 5.1 | 7 | 9.6 | 7.1 | 8.1 |