Extreme Multi-label Classification on Amazon-670K
53.02P@1ELIAS++
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ELIAS++Feature type=Sparse + Dense2022.10 | 53.02 | 47.18 | 42.97 | 34.32 | 38.12 | 41.93 | |
| CascadeXMLFeatures=[DNN tf-idf] Features, Model ensemble=32022.10 | 52.15 | 46.54 | 42.44 | — | — | — | |
| Label DisentanglementBase Model=X-Transformer2021.06 | 50.7 | 45.4 | 41.55 | 36.39 | 39.15 | 41.96 | |
| Overlap-XMCFeature type=Sparse + Dense2022.10 | 50.7 | 45.4 | 41.55 | 36.39 | 39.15 | 41.96 | |
| ELIASFeature type=Dense embedding2022.10 | 50.63 | 45.49 | 41.6 | 32.59 | 36.44 | 39.97 | |
| DENSESparsity=-, Mtr (GiB)=11.9, E. Time (mm:ss)=7:142026.05 | 50.6 | 45.2 | 41.1 | — | — | — | |
| CascadeXMLFeatures=DNN Features, Model ensemble=32022.10 | 50.41 | 45.32 | 41.55 | — | — | — | |
| XR-TransformerFeatures=[DNN tf-idf] Features, Model ensemble=32022.10 | 50.11 | 44.56 | 40.64 | — | — | — | |
| XR-TransformerFeature type=Sparse + Dense2022.10 | 50.11 | 44.56 | 40.64 | 36.16 | 38.39 | 40.99 | |
| DENSEM_tr (GiB)=11.52024.11 | 49.8 | 44.2 | 40.1 | — | — | — | |
| LightXMLFeatures=DNN Features, Model ensemble=32022.10 | 49.32 | 44.17 | 40.25 | — | — | — | |
| LightXMLFeature type=Dense embedding2022.10 | 49.1 | 43.83 | 39.85 | — | — | — | |
| CASCADEXMLM_tr (GiB)=18.32024.11 | 48.5 | 43.7 | 40 | — | — | — | |
| CASCADEXMLSparsity=-, Mtr (GiB)=18.3, E. Time (mm:ss)=16:462026.05 | 48.5 | 43.7 | 40 | — | — | — | |
| HASTE2026.05 | 48.1 | 43.1 | 39.2 | — | — | — | |
| HASTESparsity=92, Mtr (GiB)=2.1, E. Time (mm:ss)=5:392026.05 | 48.1 | 43.1 | 39.2 | — | — | — | |
| X-Transformer2021.06 | 48.07 | 42.96 | 39.12 | 36.06 | 38.38 | 41.04 | |
| X-TransformerFeatures=[DNN tf-idf] Features, Model ensemble=92022.10 | 48.07 | 42.96 | 39.12 | — | — | — | |
| AstecFeature type=Dense embedding2022.10 | 47.77 | 42.79 | 39.1 | 32.13 | 35.14 | 37.82 | |
| AttentionXMLFeatures=DNN Features, Model ensemble=32022.10 | 47.68 | 42.7 | 38.99 | — | — | — | |
| AttentionXML2021.06 | 47.58 | 42.61 | 38.92 | 30.29 | 33.85 | 37.13 | |
| AttentionXMLFeature type=Dense embedding2022.10 | 47.58 | 42.61 | 38.92 | 30.29 | 33.85 | 37.13 | |
| LIGHTXMLSparsity=-, Mtr (GiB)=12.4, E. Time (mm:ss)=53:302026.05 | 47.3 | 42.2 | 38.5 | — | — | — | |
| LIGHTXMLM_tr (GiB)=11.22024.11 | 47.1 | 42 | 38.2 | — | — | — | |
| SPARTEXSparsity (%)=83, M_tr (GiB)=3.72024.11 | 47.1 | 41.8 | 38 | — | — | — | |
| SPARTEXSparsity=83, Mtr (GiB)=3.7, E. Time (mm:ss)=8:012026.05 | 47.1 | 41.8 | 38 | — | — | — | |
| GLaSFeature type=Dense embedding2022.10 | 46.38 | 42.09 | 38.56 | 38.94 | 39.72 | 41.24 | |
| ATTENTIONXMLM_tr (GiB)=10.72024.11 | 45.7 | 40.7 | 36.9 | — | — | — | |
| Bonsai2021.06 | 45.58 | 40.39 | 36.6 | 27.08 | 30.79 | 34.11 | |
| BonsaiFeatures=Sparse, Model ensemble=32022.10 | 45.58 | 40.39 | 36.6 | — | — | — | |
| BonsaiFeature type=Sparse bag-of-word2022.10 | 45.58 | 40.39 | 36.6 | 27.08 | 30.79 | 34.11 | |
| XR-LinearFeature type=Sparse bag-of-word2022.10 | 45.36 | 40.35 | 36.71 | — | — | — | |
| RIGLSparsity (%)=83, M_tr (GiB)=12.42024.11 | 45.2 | 38.7 | 36 | — | — | — | |
| RIGL2026.05 | 45.2 | 38.7 | 36 | — | — | — | |
| BLOCK SPARSESparsity=92, Mtr (GiB)=3.2, E. Time (mm:ss)=5:352026.05 | 45 | 39.8 | 35.7 | — | — | — | |
| Parabel2021.06 | 44.91 | 39.77 | 35.98 | 26.36 | 29.95 | 33.17 | |
| ParabelFeatures=Sparse, Model ensemble=32022.10 | 44.91 | 39.77 | 35.98 | — | — | — | |
| ParabelFeature type=Sparse bag-of-word2022.10 | 44.89 | 39.8 | 36 | 25.43 | 29.43 | 32.85 | |
| DISMEC2021.06 | 44.78 | 39.72 | 36.17 | 26.26 | 30.14 | 33.89 | |
| DISMECFeatures=Sparse, Model ensemble=12022.10 | 44.78 | 39.72 | 36.17 | — | — | — | |
| DISMECFeature type=Sparse bag-of-word2022.10 | 44.7 | 39.7 | 36.1 | 27.8 | 30.6 | 34.2 | |
| DENSE BNM_tr (GiB)=4.02024.11 | 44.5 | 39.7 | 36.1 | — | — | — | |
| DENSE BNSparsity=-, Mtr (GiB)=4.0, E. Time (mm:ss)=5:322026.05 | 43.8 | 39.2 | 35.9 | — | — | — | |
| DENSESparsity=-, Mtr (GiB)=12.5, E. Time (mm:ss)=2:042026.05 | 43.7 | 39.1 | 35.9 | — | — | — | |
| XR-LinearFeatures=Sparse, Model ensemble=12022.10 | 43.38 | 38.4 | 34.77 | — | — | — | |
| HASTE2026.05 | 43 | 38.7 | 35.5 | — | — | — | |
| HASTESparsity=83, Mtr (GiB)=3.2, E. Time (mm:ss)=1:462026.05 | 43 | 38.7 | 35.5 | — | — | — | |
| SPARTEXSparsity=83, Mtr (GiB)=5.0, E. Time (mm:ss)=4:442026.05 | 42.6 | 38.2 | 35.1 | — | — | — | |
| eXtremeText2021.06 | 42.54 | 37.93 | 34.63 | — | — | — | |
| eXtremeTextFeatures=Sparse, Model ensemble=12022.10 | 42.54 | 37.93 | 34.63 | — | — | — | |
| XR-LINEAR2021.06 | 42.51 | 37.32 | 33.6 | — | — | — | |
| CASCADEXMLSparsity=-, Mtr (GiB)=22.3, E. Time (mm:ss)=11:322026.05 | 42.1 | 37.5 | 34.1 | — | — | — | |
| AnnexML2021.06 | 42.09 | 36.61 | 32.75 | 21.46 | 24.67 | 27.53 | |
| RIGL2026.05 | 42 | 37.3 | 34.4 | — | — | — | |
| LIGHTXMLSparsity=-, Mtr (GiB)=15.0, E. Time (mm:ss)=19:022026.05 | 41.6 | 37.2 | 33.9 | — | — | — | |
| SPLAT2026.05 | 41.4 | 36.2 | 32.3 | — | — | — | |
| DENSE BNSparsity=-, Mtr (GiB)=3.9, E. Time (mm:ss)=1:422026.05 | 41.3 | 36.8 | 33.7 | — | — | — | |
| VENOM2026.05 | 41.2 | 36.1 | 32 | — | — | — | |
| SPLAT2026.05 | 40.5 | 36.2 | 33 | — | — | — | |
| VENOM2026.05 | 39.5 | 35 | 31.6 | — | — | — | |
| BLOCK SPARSESparsity=83, Mtr (GiB)=5.3, E. Time (mm:ss)=1:442026.05 | 39.4 | 34.6 | 30.9 | — | — | — | |
| XML-CNN2021.06 | 33.41 | 30 | 27.42 | 17.43 | 21.66 | 24.42 | |
| SliceFeature type=Dense embedding2022.10 | 33.15 | 29.76 | 26.93 | 20.2 | 22.69 | 24.7 | |
| AttentionXMLModel setting=Single Model, Feature type=DNN2022.10 | — | — | — | 29.3 | 32.36 | 35.12 | |
| AttentionXML*Model setting=Ensemble Model, Feature type=DNN2022.10 | — | — | — | 30.29 | 33.85 | 37.13 | |
| BonsaiFeature type=Baseline/tf-idf2022.10 | — | — | — | 27.08 | 30.79 | 34.11 | |
| CascadeXMLModel setting=Single Model, Feature type=DNN2022.10 | — | — | — | 30.45 | 35.02 | 38.97 | |
| CascadeXML*Model setting=Ensemble Model, Feature type=DNN2022.10 | — | — | — | 31.4 | 36.22 | 40.28 | |
| CascadeXML*Model setting=Ensemble Model, Feature type=DNN tf-idf2022.10 | — | — | — | 30.77 | 35.78 | 40.52 | |
| DENSE BN2026.05 | — | — | — | 23.8 | 28.1 | 32.2 | |
| DISMECFeature type=Baseline/tf-idf2022.10 | — | — | — | 26.26 | 30.14 | 33.89 | |
| HASTE2026.05 | — | — | — | 25.3 | 29.2 | 33 | |
| ParabelFeature type=Baseline/tf-idf2022.10 | — | — | — | 26.36 | 29.95 | 33.17 | |
| PfastreXMLFeature type=Baseline/tf-idf2022.10 | — | — | — | 29.3 | 30.8 | 32.43 | |
| ProXMLFeature type=Baseline/tf-idf2022.10 | — | — | — | 30.31 | 32.31 | 34.43 | |
| RENEE2026.05 | — | — | — | 27 | 31.1 | 34.89 | |
| SPARTEX2026.05 | — | — | — | 24.1 | 28 | 31.6 | |
| XML-CNNModel setting=Single Model, Feature type=DNN2022.10 | — | — | — | 17.43 | 21.66 | 24.42 | |
| XR-TransformerModel setting=Single Model, Feature type=DNN2022.10 | — | — | — | 29.21 | 33.49 | 37.65 | |
| XR-Transformer*Model setting=Ensemble Model, Feature type=DNN tf-idf2022.10 | — | — | — | 29.77 | 34.05 | 38.29 |