Positive-Unlabeled Classification on 14 imbalanced datasets SCAR assumption macro-averaged
0.92ROC AUCXGBoostFL
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| XGBoostFLLabeled proportion=25%, Setting=Positive-Negative, Configuration=XGBoost supervised, focal loss, default hyper-parameters2026.05 | 0.92 | 0.67 | |
| XGBoostFLLabeled proportion=50%, Setting=Positive-Negative, Configuration=XGBoost supervised, focal loss, default hyper-parameters2026.05 | 0.92 | 0.67 | |
| XGBoostFLLabeled proportion=75%, Setting=Positive-Negative, Configuration=XGBoost supervised, focal loss, default hyper-parameters2026.05 | 0.92 | 0.67 | |
| XGBoostLabeled proportion=25%, Setting=Positive-Negative, Configuration=XGBoost supervised, standard loss, default hyper-parameters2026.05 | 0.9 | 0.65 | |
| XGBoostLabeled proportion=50%, Setting=Positive-Negative, Configuration=XGBoost supervised, standard loss, default hyper-parameters2026.05 | 0.9 | 0.65 | |
| XGBoostLabeled proportion=75%, Setting=Positive-Negative, Configuration=XGBoost supervised, standard loss, default hyper-parameters2026.05 | 0.9 | 0.65 | |
| PUHRFLabeled proportion=75%, Setting=Positive-Unlabeled, Configuration=PU Hellinger Random forest, default hyper-parameters2026.05 | 0.89 | 0.63 | |
| NNIFLabeled proportion=75%, Setting=Positive-Unlabeled, Configuration=XGBoost, default hyper-parameters2026.05 | 0.87 | 0.53 | |
| PUHRFLabeled proportion=50%, Setting=Positive-Unlabeled, Configuration=PU Hellinger Random forest, default hyper-parameters2026.05 | 0.87 | 0.59 | |
| iFPUXGBLabeled proportion=75%, Setting=Positive-Unlabeled, Configuration=XGBoost, PU focal loss, default hyper-parameters2026.05 | 0.87 | 0.6 | |
| LBELabeled proportion=75%, Setting=Positive-Unlabeled, Configuration=MLP, default hyper-parameters2026.05 | 0.86 | 0.53 | |
| NNIFLabeled proportion=50%, Setting=Positive-Unlabeled, Configuration=XGBoost, default hyper-parameters2026.05 | 0.85 | 0.5 | |
| SAREMLabeled proportion=75%, Setting=Positive-Unlabeled, Configuration=Expectation-Maximization, default parameters2026.05 | 0.85 | 0.56 | |
| iFPUXGBLabeled proportion=50%, Setting=Positive-Unlabeled, Configuration=XGBoost, PU focal loss, default hyper-parameters2026.05 | 0.85 | 0.57 | |
| LBELabeled proportion=50%, Setting=Positive-Unlabeled, Configuration=MLP, default hyper-parameters2026.05 | 0.84 | 0.53 | |
| SAREMLabeled proportion=50%, Setting=Positive-Unlabeled, Configuration=Expectation-Maximization, default parameters2026.05 | 0.84 | 0.55 | |
| PUHRFLabeled proportion=25%, Setting=Positive-Unlabeled, Configuration=PU Hellinger Random forest, default hyper-parameters2026.05 | 0.83 | 0.52 | |
| NNIFLabeled proportion=25%, Setting=Positive-Unlabeled, Configuration=XGBoost, default hyper-parameters2026.05 | 0.81 | 0.46 | |
| SAREMLabeled proportion=25%, Setting=Positive-Unlabeled, Configuration=Expectation-Maximization, default parameters2026.05 | 0.81 | 0.51 | |
| LBELabeled proportion=25%, Setting=Positive-Unlabeled, Configuration=MLP, default hyper-parameters2026.05 | 0.8 | 0.49 | |
| iFPUXGBLabeled proportion=25%, Setting=Positive-Unlabeled, Configuration=XGBoost, PU focal loss, default hyper-parameters2026.05 | 0.8 | 0.52 | |
| PUHDTLabeled proportion=75%, Setting=Positive-Unlabeled, Configuration=PU Hellinger Decision Tree, default hyper-parameters2026.05 | 0.79 | 0.46 | |
| PUHDTLabeled proportion=50%, Setting=Positive-Unlabeled, Configuration=PU Hellinger Decision Tree, default hyper-parameters2026.05 | 0.77 | 0.43 | |
| PUHDTLabeled proportion=25%, Setting=Positive-Unlabeled, Configuration=PU Hellinger Decision Tree, default hyper-parameters2026.05 | 0.72 | 0.4 | |
| iFPUMLPLabeled proportion=75%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, PU focal loss2026.05 | 0.62 | 0.14 | |
| iFPUMLPLabeled proportion=50%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, PU focal loss2026.05 | 0.6 | 0.14 | |
| iFPUMLPLabeled proportion=25%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, PU focal loss2026.05 | 0.58 | 0.13 | |
| uPULabeled proportion=75%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, sigmoid loss2026.05 | 0.56 | 0.13 | |
| nnPULabeled proportion=75%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, sigmoid loss2026.05 | 0.56 | 0.13 | |
| i-NNPULabeled proportion=50%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, sigmoid loss2026.05 | 0.56 | 0.13 | |
| i-NNPULabeled proportion=75%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, sigmoid loss2026.05 | 0.56 | 0.13 | |
| uPULabeled proportion=50%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, sigmoid loss2026.05 | 0.55 | 0.13 | |
| nnPULabeled proportion=50%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, sigmoid loss2026.05 | 0.55 | 0.13 | |
| nnPULabeled proportion=25%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, sigmoid loss2026.05 | 0.54 | 0.12 | |
| i-NNPULabeled proportion=25%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, sigmoid loss2026.05 | 0.54 | 0.12 | |
| uPULabeled proportion=25%, Setting=Positive-Unlabeled, Configuration=MLP, 5 layers, sigmoid loss2026.05 | 0.53 | 0.12 |