Deep Metric Learning on CUB200 2011 (test)
71.4Recall@1MS + Metrix
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MS + MetrixBackbone=ResNet-50, Embedding size=512, Metrix variant=feature mixup2021.06 | 71.4 | 80.6 | 86.8 | — | — | |
| S2SD+PLGBackbone=ResNet50, Embedding Dimension=5122022.03 | 71.4 | 81.1 | — | 0.735 | — | |
| S2SD+PLGBackbone=ResNet50, Embedding Dimension=1282022.03 | 71.1 | 80.6 | — | 0.73 | — | |
| PA + MetrixBackbone=ResNet-50, Embedding size=512, Metrix variant=feature mixup2021.06 | 71 | 81.8 | 88.2 | — | — | |
| PA + Metrix/inputBackbone=ResNet-50, Embedding size=512, Metrix variant=input mixup2021.06 | 70.5 | 81.2 | 87.8 | — | — | |
| PA+NIRBackbone=ResNet-50, Dimension=512, combined_pooling=true2022.03 | 70.5 | 80.6 | — | 0.725 | — | |
| PA + Metrix/embedBackbone=ResNet-50, Embedding size=512, Metrix variant=embedding mixup2021.06 | 70.4 | 81.1 | 87.9 | — | — | |
| ProxyNCA++ + MetrixBackbone=ResNet-50, Embedding size=512, Metrix variant=feature mixup2021.06 | 70.4 | 80.6 | 88.7 | — | — | |
| S2SD+PLGBackbone=Inception-BN, Embedding Dimension=5122022.03 | 70.4 | 80.5 | — | 0.719 | — | |
| Intra-Batch ConnectionsEvaluation Protocol=Standard2021.02 | 70.3 | — | — | — | — | |
| IB-DMLBackbone=ResNet50, Embedding Dimension=512, Optimizer=RAdam, Input Image Size=Larger2022.03 | 70.3 | 80.3 | — | 0.74 | — | |
| MS + Metrix/embedBackbone=ResNet-50, Embedding size=512, Metrix variant=embedding mixup2021.06 | 70.2 | 80.4 | 86.7 | — | — | |
| ProxyNCA++ + Metrix/embedBackbone=ResNet-50, Embedding size=512, Metrix variant=embedding mixup2021.06 | 70.2 | 80.2 | 88.2 | — | — | |
| PA+NIRBackbone=IBN, Dimension=512, combined_pooling=true2022.03 | 70.1 | 80.1 | — | 0.71 | — | |
| PABackbone=ResNet-50, Embedding size=512, source=reported2021.06 | 69.7 | 80 | 87 | — | — | |
| ProxyNCA++ + Metrix/inputBackbone=ResNet-50, Embedding size=512, Metrix variant=input mixup2021.06 | 69.7 | 79.9 | 88.3 | — | — | |
| Multisimilarity+PLGBackbone=ResNet50, Embedding Dimension=5122022.03 | 69.6 | 79.5 | — | 0.707 | — | |
| PABackbone=ResNet-50, Embedding size=512, source=reproduced2021.06 | 69.5 | 79.3 | 87 | — | — | |
| PA+NIRBackbone=IBN, Dimension=5122022.03 | 69.4 | 79.7 | — | 0.711 | — | |
| DiVA-R50-512Dim=512, Backbone=ResNet502020.04 | 69.2 | 79.3 | — | 71.4 | — | |
| DiVABackbone=ResNet50, Embedding Dimension=5122022.03 | 69.2 | 79.3 | — | 0.714 | — | |
| Multisimilarity+PLGBackbone=Inception-BN, Embedding Dimension=5122022.03 | 69.2 | 79.7 | — | 0.706 | — | |
| DiVABackbone=ResNet-50, Dimension=5122022.03 | 69.2 | 79.3 | — | 0.714 | — | |
| ProxyNCA++Backbone=ResNet-50, Embedding size=512, source=reproduced2021.06 | 69.1 | 79.5 | 87.7 | — | — | |
| PA+NIRBackbone=ResNet-50, Dimension=5122022.03 | 69.1 | 79.6 | — | 0.72 | — | |
| ProxyNCA++Backbone=ResNet-50, Embedding size=512, source=reported2021.06 | 69 | 79.8 | 87.3 | — | — | |
| MS + Metrix/inputBackbone=ResNet-50, Embedding size=512, Metrix variant=input mixup2021.06 | 69 | 79.1 | 86 | — | — | |
| PA+MemVirBackbone=IBN, Dimension=5122022.03 | 69 | 79.2 | — | — | — | |
| S2SDBackbone=ResNet50, Embedding Dimension=1282022.03 | 68.9 | 79 | — | 0.721 | — | |
| DRMLBackbone=IBN, Dimension=5122022.03 | 68.7 | 78.6 | — | 0.693 | — | |
| R-Margin + MSDFABaseline Objective=Relaxed Margin Loss, beta=0.6, S2SD Variant=Multiscale Self-Distillation with Features and Affinities, Backbone=ResNet-502020.09 | 68.58 | — | — | 0.7164 | — | |
| Trip-DiVA-R50-512Dim=512, Backbone=ResNet502020.04 | 68.5 | 78.5 | — | 71.1 | — | |
| DCML-MDWBackbone=ResNet50, Embedding Dimension=5122022.03 | 68.4 | 77.9 | — | 0.718 | — | |
| ProxyAnchorBackbone=Inception-BN, Embedding Dimension=512, Pooling Operations=Combination in backbone2022.03 | 68.4 | 79.2 | — | — | — | |
| ProxyAnchorBackbone=IBN, Dimension=512, combined_pooling=true2022.03 | 68.4 | 79.2 | — | — | — | |
| DCML-MDWBackbone=ResNet-50, Dimension=5122022.03 | 68.4 | 77.9 | — | 0.718 | — | |
| R-Margin + MSDFBaseline Objective=Relaxed Margin Loss, beta=0.6, S2SD Variant=Multiscale Self-Distillation with Features, Backbone=ResNet-502020.09 | 68.12 | — | — | 0.718 | — | |
| PA+NIRBackbone=ResNet-50, Dimension=128, combined_pooling=true2022.03 | 67.9 | 78.3 | — | 0.714 | — | |
| MSBackbone=ResNet-50, Embedding size=5122021.06 | 67.8 | 77.8 | 85.6 | — | — | |
| Multisimilarity+PLGBackbone=ResNet50, Embedding Dimension=1282022.03 | 67.8 | 78.2 | — | 0.701 | — | |
| Multisimilarity + MSDFABaseline Objective=Multisimilarity Loss, S2SD Variant=Multiscale Self-Distillation with Features and Affinities, Backbone=ResNet-502020.09 | 67.68 | — | — | 0.714 | — | |
| Margin + MSDFBaseline Objective=Margin Loss, beta=1.2, S2SD Variant=Multiscale Self-Distillation with Features, Backbone=ResNet-502020.09 | 67.58 | — | — | 0.7147 | — | |
| Cont + MetrixBackbone=ResNet-50, Embedding size=512, Metrix variant=feature mixup2021.06 | 67.4 | 77.9 | 85.7 | — | — | |
| Ours (Margin + PADS)Dim=1282020.03 | 67.3 | 78 | 85.9 | 69.9 | — | |
| SoftTripleBackbone=ResNet-50, Embedding size=5122021.06 | 67.3 | 77.7 | 86.2 | — | — | |
| PADSBackbone=ResNet50, Embedding Dimension=1282022.03 | 67.3 | 78 | — | 0.699 | — | |
| PADSBackbone=ResNet-50, Dimension=1282022.03 | 67.3 | 78 | — | 0.699 | — | |
| Margin + MSDFABaseline Objective=Margin Loss, beta=1.2, S2SD Variant=Multiscale Self-Distillation with Features and Affinities, Backbone=ResNet-502020.09 | 67.21 | — | — | 0.7143 | — | |
| Intra-Batch ConnectionsEvaluation Protocol=Reality Check (Musgrave et al., 2020)2021.02 | 67.1 | — | — | — | — | |
| Multisimilarity + MSDFBaseline Objective=Multisimilarity Loss, S2SD Variant=Multiscale Self-Distillation with Features, Backbone=ResNet-502020.09 | 67.04 | — | — | 0.7187 | — | |
| PA+NIRBackbone=ResNet-50, Dimension=1282022.03 | 66.9 | 77.7 | — | 0.698 | — | |
| R-Margin + MSDBaseline Objective=Relaxed Margin Loss, beta=0.6, S2SD Variant=Multiscale Self-Distillation, Backbone=ResNet-502020.09 | 66.81 | — | — | 0.7047 | — | |
| DiVA-IBN-512Dim=512, Backbone=Inception-BN2020.04 | 66.8 | 77.7 | — | 70 | — | |
| Trip-DiVA-IBN-512Dim=512, Backbone=Inception-BN2020.04 | 66.7 | 77.1 | — | 69.3 | — | |
| RankMIBackbone=ResNet-50, Dimension=1282022.03 | 66.7 | 77.2 | — | 0.713 | — | |
| CircleBackbone=ResNet-50, Dimension=5122022.03 | 66.7 | 77.2 | — | — | — | |
| PADS (Margin + IBN)Dim=512, Backbone=Inception-BN, IBN=true2020.03 | 66.6 | 77.2 | 85.6 | 68.5 | — | |
| ProxyGMLBackbone=Inception-BN, Embedding Dimension=5122022.03 | 66.6 | 77.6 | — | 0.698 | — | |
| ProxyGMLBackbone=IBN, Dimension=5122022.03 | 66.6 | 77.6 | — | 0.698 | — | |
| R-Margin + DSDBaseline Objective=Relaxed Margin Loss, beta=0.6, S2SD Variant=Dual Self-Distillation, Backbone=ResNet-502020.09 | 66.58 | — | — | 0.7003 | — | |
| Cont + Metrix/embedBackbone=ResNet-50, Embedding size=512, Metrix variant=embedding mixup2021.06 | 66.4 | 77.6 | 85.4 | — | — | |
| HORDE + Contr.Dim=512, Backbone=Inception-BN2020.03 | 66.3 | 76.7 | 84.7 | — | — | |
| HORDE + contrastive lossDim=5122020.03 | 66.3 | 76.7 | 84.7 | — | — | |
| HORDE + Contr.Dim=5122020.04 | 66.3 | 76.7 | — | — | — | |
| Cont + Metrix/inputBackbone=ResNet-50, Embedding size=512, Metrix variant=input mixup2021.06 | 66.3 | 77.1 | 85.2 | — | — | |
| Margin + MSDBaseline Objective=Margin Loss, beta=1.2, S2SD Variant=Multiscale Self-Distillation, Backbone=ResNet-502020.09 | 66.13 | — | — | 0.7083 | — | |
| MICDim=128, Backbone=Inception-BN2020.03 | 66.1 | 76.8 | 85.6 | 69.7 | — | |
| MICDim=1282020.03 | 66.1 | 76.8 | 85.6 | 69.7 | — | |
| MICDim=1282020.04 | 66.1 | 76.8 | — | 69.7 | — | |
| MICBackbone=ResNet50, Embedding Dimension=1282022.03 | 66.1 | 76.8 | — | 0.697 | — | |
| DR-MSBackbone=Inception-BN, Embedding Dimension=5122022.03 | 66.1 | 77 | — | — | — | |
| MICBackbone=ResNet-50, Dimension=1282022.03 | 66.1 | 76.8 | — | 0.697 | — | |
| D&CDim=128, Backbone=Inception-BN2020.03 | 65.9 | 76.6 | 84.4 | 69.6 | — | |
| D&CDim=1282020.03 | 65.9 | 76.6 | 84.4 | 69.6 | — | |
| D&CDim=1282020.04 | 65.9 | 76.6 | — | 69.6 | — | |
| LiftedStructureBackbone=ResNet-50, Embedding size=5122021.06 | 65.9 | 75.8 | 84.5 | — | — | |
| D&CBackbone=ResNet-50, Embedding size=5122021.06 | 65.9 | 76.6 | 84.4 | — | — | |
| Div&ConqBackbone=ResNet50, Embedding Dimension=1282022.03 | 65.9 | 76.6 | — | 0.696 | — | |
| Div&ConqBackbone=ResNet-50, Dimension=1282022.03 | 65.9 | 76.6 | — | 0.696 | — | |
| Multisimilarity + MSDBaseline Objective=Multisimilarity Loss, S2SD Variant=Multiscale Self-Distillation, Backbone=ResNet-502020.09 | 65.8 | — | — | 0.7066 | — | |
| MultiSimDim=5122020.04 | 65.7 | 77 | — | — | — | |
| MultisimilarityBackbone=Inception-BN, Embedding Dimension=5122022.03 | 65.7 | 77 | — | — | — | |
| Multisimilarity + DSDBaseline Objective=Multisimilarity Loss, S2SD Variant=Dual Self-Distillation, Backbone=ResNet-502020.09 | 65.57 | — | — | 0.7008 | — | |
| GroupBackbone=Inception-BN, Embedding Dimension=5122022.03 | 65.5 | 77 | — | 0.69 | — | |
| SOFT-TRIPLEDim=512, Backbone=Inception-BN2020.03 | 65.4 | 76.4 | 84.5 | — | — | |
| SOFT-TRIPLEDim=5122020.03 | 65.4 | 76.4 | 84.5 | — | — | |
| SofttripleDim=5122020.04 | 65.4 | 76.4 | — | — | — | |
| ProxyNCABackbone=ResNet-50, Embedding size=5122021.06 | 65.2 | 75.6 | 83.8 | — | — | |
| Margin + DSDBaseline Objective=Margin Loss, beta=1.2, S2SD Variant=Dual Self-Distillation, Backbone=ResNet-502020.09 | 65.11 | — | — | 0.6965 | — | |
| MarginBackbone=ResNet-50, Embedding size=5122021.06 | 65 | 76.2 | 84.6 | — | — | |
| R-MarginBaseline Objective=Relaxed Margin Loss, beta=0.6, Backbone=ResNet-502020.09 | 64.93 | — | — | 0.6836 | — | |
| EPSHNBackbone=ResNet-50, Embedding size=5122021.06 | 64.9 | 75.3 | 83.5 | — | — | |
| EPSHNBackbone=ResNet50, Embedding Dimension=5122022.03 | 64.9 | 75.3 | — | — | — | |
| EPSHNBackbone=ResNet-50, Dimension=5122022.03 | 64.9 | 75.3 | — | — | — | |
| ContBackbone=ResNet-50, Embedding size=5122021.06 | 64.7 | 75.9 | 84.6 | — | — | |
| Margin-R50-512Dim=512, Backbone=ResNet502020.04 | 64.4 | 75.4 | — | 68.4 | — | |
| DREMLDim=9216, Backbone=Inception-BN2020.03 | 63.9 | 75 | 83.1 | 67.8 | — | |
| DREMLDim=92162020.03 | 63.9 | 75 | 83.1 | 67.8 | — | |
| DREMLDim=9216, Type=Ensemble2020.04 | 63.9 | 75 | — | 67.8 | — | |
| Margin (Re-implemented)Dim=512, Backbone=Inception-BN, IBN=true2020.03 | 63.8 | 75.3 | 84.7 | 67.9 | — |