Extreme Multi-label Classification Performance on Wiki 500K
81.26P@1ELIAS++
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ELIAS++Feature type=Sparse + Dense2022.10 | 81.26 | 62.51 | 48.82 | 35.02 | 45.94 | 51.13 | |
| CascadeXMLFeatures=[DNN tf-idf] Features, Model ensemble=32022.10 | 81.13 | 62.43 | 49.12 | — | — | — | |
| XR-TransformerFeatures=[DNN tf-idf] Features, Model ensemble=32022.10 | 79.4 | 59.02 | 46.25 | — | — | — | |
| XR-TransformerFeature type=Sparse + Dense2022.10 | 79.4 | 59.02 | 46.25 | 35.76 | 42.22 | 46.36 | |
| ELIASFeature type=Dense embedding2022.10 | 79 | 60.37 | 46.87 | 33.86 | 42.99 | 47.29 | |
| DENSEM_tr (GiB)=92024.11 | 78.5 | 59.2 | 45.6 | — | — | — | |
| CascadeXMLFeatures=DNN Features, Model ensemble=32022.10 | 78.39 | 59.86 | 46.49 | — | — | — | |
| LightXMLFeatures=DNN Features, Model ensemble=32022.10 | 77.89 | 58.98 | 45.71 | — | — | — | |
| LightXMLFeature type=Dense embedding2022.10 | 77.78 | 58.85 | 45.57 | — | — | — | |
| X-TransformerFeatures=[DNN tf-idf] Features, Model ensemble=92022.10 | 77.09 | 57.51 | 45.28 | — | — | — | |
| CASCADEXMLM_tr (GiB)=18.82024.11 | 77 | 58.3 | 45.1 | — | — | — | |
| AttentionXMLFeature type=Dense embedding2022.10 | 76.95 | 58.42 | 46.14 | 30.85 | 39.23 | — | |
| AttentionXMLFeatures=DNN Features, Model ensemble=32022.10 | 76.74 | 58.18 | 45.95 | — | — | — | |
| SPARTEXSparsity (%)=83, M_tr (GiB)=4.12024.11 | 76.7 | 57.8 | 44.5 | — | — | — | |
| LIGHTXMLM_tr (GiB)=14.62024.11 | 76.2 | 57.2 | 44.1 | — | — | — | |
| ATTENTIONXMLM_tr (GiB)=13.12024.11 | 75.1 | 56.5 | 44.4 | — | — | — | |
| RIGLSparsity (%)=83, M_tr (GiB)=9.72024.11 | 74.5 | 54.7 | 41.8 | — | — | — | |
| DENSE BNM_tr (GiB)=4.32024.11 | 73.8 | 55.1 | 42 | — | — | — | |
| AstecFeature type=Dense embedding2022.10 | 73.02 | 52.02 | 40.53 | 30.69 | 36.48 | 40.38 | |
| DISMECFeatures=Sparse, Model ensemble=12022.10 | 70.21 | 50.57 | 39.68 | — | — | — | |
| DISMECFeature type=Sparse bag-of-word2022.10 | 70.21 | 50.57 | 39.68 | 31.2 | 33.4 | 37 | |
| GLaSFeature type=Dense embedding2022.10 | 69.91 | 49.08 | 38.35 | — | — | — | |
| BonsaiFeatures=Sparse, Model ensemble=32022.10 | 69.26 | 49.8 | 38.83 | — | — | — | |
| BonsaiFeature type=Sparse bag-of-word2022.10 | 69.2 | 49.8 | 38.8 | — | — | — | |
| ParabelFeatures=Sparse, Model ensemble=32022.10 | 68.7 | 49.57 | 38.64 | — | — | — | |
| ParabelFeature type=Sparse bag-of-word2022.10 | 68.7 | 49.57 | 38.64 | 26.88 | 31.96 | 35.26 | |
| XR-LinearFeature type=Sparse bag-of-word2022.10 | 68.12 | 49.07 | 38.39 | — | — | — | |
| XR-LinearFeatures=Sparse, Model ensemble=12022.10 | 65.59 | 46.72 | 36.46 | — | — | — | |
| eXtremeTextFeatures=Sparse, Model ensemble=12022.10 | 65.17 | 46.32 | 36.15 | — | — | — | |
| SliceFeature type=Dense embedding2022.10 | 62.62 | 41.79 | 31.57 | 24.48 | 27.01 | 29.07 | |
| AttentionXMLModel setting=Single Model, Feature type=DNN2022.10 | — | — | — | 30.05 | 37.31 | 41.74 | |
| AttentionXML*Model setting=Ensemble Model, Feature type=DNN2022.10 | — | — | — | 30.85 | 39.23 | 44.34 | |
| BonsaiFeature type=Baseline/tf-idf2022.10 | — | — | — | 27.46 | 32.25 | 35.48 | |
| CascadeXMLModel setting=Single Model, Feature type=DNN2022.10 | — | — | — | 31.25 | 39.35 | 43.29 | |
| CascadeXML*Model setting=Ensemble Model, Feature type=DNN2022.10 | — | — | — | 32.6 | 42.03 | 46.66 | |
| CascadeXML*Model setting=Ensemble Model, Feature type=DNN tf-idf2022.10 | — | — | — | 32.12 | 43.15 | 49.37 | |
| DISMECFeature type=Baseline/tf-idf2022.10 | — | — | — | 27.42 | 32.95 | 36.95 | |
| ParabelFeature type=Baseline/tf-idf2022.10 | — | — | — | 26.88 | 31.96 | 35.26 | |
| PfastreXMLFeature type=Baseline/tf-idf2022.10 | — | — | — | 32.02 | 29.75 | 30.19 | |
| XR-TransformerModel setting=Single Model, Feature type=DNN2022.10 | — | — | — | 32.1 | 39.41 | 43.75 | |
| XR-Transformer*Model setting=Ensemble Model, Feature type=DNN tf-idf2022.10 | — | — | — | 32.7 | 40.44 | 45.02 |