Extreme Multi-label Classification on Amazon-3M
54.28Precision@1ELIAS++
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ELIAS++Feature type=Sparse + Dense2022.10 | 54.28 | 51.4 | 49.09 | 15.85 | 19.07 | 21.52 | |
| XR-TransformerFeatures=[DNN tf-idf] Features, Model ensemble=32022.10 | 54.2 | 50.81 | 48.26 | — | — | — | |
| XR-TransformerFeature type=Sparse + Dense2022.10 | 54.2 | 50.81 | 48.26 | 20.52 | 23.64 | 25.79 | |
| CascadeXMLFeatures=[DNN tf-idf] Features, Model ensemble=32022.10 | 53.91 | 51.24 | 49.52 | — | — | — | |
| DENSEM_tr (GiB)=46.32024.11 | 53.4 | 50.6 | 48.5 | — | — | — | |
| ELMONumerical precision=BF16, Mtr (GiB)=10.4, E. Time (mm:ss)=16:13, Sparsity=92%2026.05 | 53.4 | 50.9 | 48.8 | — | — | — | |
| CascadeXMLFeatures=DNN Features, Model ensemble=32022.10 | 52.75 | 50.83 | 48.9 | — | — | — | |
| Label DisentanglementBase Model=X-Transformer2021.06 | 52.7 | 49.92 | 47.71 | 18.79 | 21.9 | 24.1 | |
| Overlap-XMCFeature type=Sparse + Dense2022.10 | 52.7 | 49.92 | 47.71 | 18.79 | 21.9 | 24.1 | |
| ELMONumerical precision=FP8, Mtr (GiB)=6.6, E. Time (mm:ss)=18:02, Sparsity=92%2026.05 | 52.7 | 50.4 | 48.3 | — | — | — | |
| DENSESparsity=-, Mtr (GiB)=39.7, E. Time (mm:ss)=29:582026.05 | 52.6 | 49.7 | 47.4 | — | — | — | |
| HASTE2026.05 | 52.5 | 49.5 | 47.4 | — | — | — | |
| HASTESparsity=92, Mtr (GiB)=5.67, E. Time (mm:ss)=21:392026.05 | 52.5 | 49.5 | 47.4 | — | — | — | |
| HASTENumerical precision=BF16, Mtr (GiB)=5.67, E. Time (mm:ss)=14:11, Sparsity=92%2026.05 | 52.5 | 49.5 | 47.4 | — | — | — | |
| ELIASFeature type=Dense embedding2022.10 | 51.72 | 48.99 | 46.89 | 16.05 | 19.39 | 21.81 | |
| CASCADEXMLM_tr (GiB)=87.02024.11 | 51.3 | 49 | 46.9 | — | — | — | |
| CASCADEXMLSparsity=-, Mtr (GiB)=87.0, E. Time (mm:ss)=90:002026.05 | 51.3 | 49 | 46.9 | — | — | — | |
| X-Transformer2021.06 | 51.2 | 47.81 | 45.07 | 18.64 | 21.56 | 23.65 | |
| X-TransformerFeatures=[DNN tf-idf] Features, Model ensemble=92022.10 | 51.2 | 47.81 | 45.07 | — | — | — | |
| AttentionXML2021.06 | 50.86 | 48.04 | 45.83 | 15.52 | 18.45 | 20.6 | |
| AttentionXMLFeatures=DNN Features, Model ensemble=32022.10 | 50.86 | 48 | 45.82 | — | — | — | |
| AttentionXMLFeature type=Dense embedding2022.10 | 50.86 | 48.04 | 45.83 | 15.52 | 18.45 | 20.6 | |
| SPARTEXSparsity (%)=83, M_tr (GiB)=13.52024.11 | 50.2 | 47.1 | 44.8 | — | — | — | |
| SPARTEXSparsity=83, Mtr (GiB)=13.5, E. Time (mm:ss)=86:382026.05 | 50.2 | 47.1 | 44.8 | — | — | — | |
| AnnexML2021.06 | 49.3 | 45.55 | 43.11 | 11.69 | 14.07 | 15.98 | |
| ATTENTIONXMLM_tr (GiB)=71.22024.11 | 49.1 | 46 | 43.9 | — | — | — | |
| Bonsai2021.06 | 48.45 | 45.65 | 43.49 | 13.79 | 16.71 | 18.87 | |
| BonsaiFeatures=Sparse, Model ensemble=32022.10 | 48.45 | 45.65 | 43.49 | — | — | — | |
| BonsaiFeature type=Sparse bag-of-word2022.10 | 48.45 | 45.65 | 43.49 | 13.79 | 16.71 | 18.87 | |
| XR-LinearFeature type=Sparse bag-of-word2022.10 | 47.96 | 45.09 | 42.96 | — | — | — | |
| ParabelFeature type=Sparse bag-of-word2022.10 | 47.48 | 44.65 | 42.53 | 12.82 | 15.61 | 17.73 | |
| Parabel2021.06 | 47.42 | 44.66 | 42.55 | 12.8 | 15.5 | 17.55 | |
| ParabelFeatures=Sparse, Model ensemble=32022.10 | 47.42 | 44.66 | 42.55 | — | — | — | |
| XR-LinearFeatures=Sparse, Model ensemble=12022.10 | 47.4 | 44.15 | 41.87 | — | — | — | |
| DISMEC2021.06 | 47.34 | 44.96 | 42.8 | — | — | — | |
| DISMECFeatures=Sparse, Model ensemble=12022.10 | 47.34 | 44.96 | 42.8 | — | — | — | |
| DISMECFeature type=Sparse bag-of-word2022.10 | 47.34 | 44.96 | 42.8 | — | — | — | |
| DENSE BNM_tr (GiB)=13.12024.11 | 47 | 44.6 | 42.7 | — | — | — | |
| VENOM2026.05 | 47 | 43.2 | 40.7 | — | — | — | |
| DENSE BNSparsity=-, Mtr (GiB)=13.1, E. Time (mm:ss)=21:172026.05 | 47 | 44.6 | 42.7 | — | — | — | |
| XR-LINEAR2021.06 | 46.65 | 43.38 | 41.05 | — | — | — | |
| eXtremeText2021.06 | 42.2 | 39.28 | 37.24 | — | — | — | |
| eXtremeTextFeatures=Sparse, Model ensemble=12022.10 | 42.2 | 39.28 | 37.24 | — | — | — | |
| BLOCK SPARSESparsity=92, Mtr (GiB)=10.1, E. Time (mm:ss)=23:562026.05 | 27.9 | 25.1 | 23.5 | — | — | — |