Image Classification on CIFAR-100 (test) (Uniform and Class Dependent η Accuracy)
79.7Accuracy (Symmetric 20%)SSR+
Evaluation results
| Method | Links | ||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SSR+Advanced Training Config (SSL/Co-training/Pre-training)=false2021.11 | 79.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 77.2 | 71.9 | 66.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugDesc2022.10 | 79.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 77.2 | 66.4 | 41.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| AugDescAdvanced Training Config (SSL/Co-training/Pre-training)=true2021.11 | 79.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 77.2 | 66.4 | 41.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NGCAdvanced Training Config (SSL/Co-training/Pre-training)=false2021.11 | 79.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.9 | 62.7 | 29.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RRL2023.03 | 79.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 74.8 | 57.7 | 29.3 | — | — | — | — | — | — | — | — | — | 60.2 | — | — | — | — | — | — | — | — | — | |
| RRLAdvanced Training Config (SSL/Co-training/Pre-training)=false2021.11 | 79.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 74.8 | 57.7 | 29.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SSRAdvanced Training Config (SSL/Co-training/Pre-training)=false2021.11 | 79 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.9 | 69.5 | 61.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SOP+Backbone=ResNet342022.02 | 78.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.9 | 63.3 | — | — | — | — | 78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FSREpoch Selection=Best2021.03 | 78.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 46.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ContrastToDivide2022.10 | 78.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 76.4 | 67.8 | 58.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| C2DAdvanced Training Config (SSL/Co-training/Pre-training)=true2021.11 | 78.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 76.4 | 67.8 | 58.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MentorMixEpoch Selection=Best2021.03 | 78.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 41.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| TCL2023.03 | 78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.3 | 65 | 54.5 | — | — | — | — | — | — | — | — | — | 67.7 | — | — | — | — | — | — | — | — | — | |
| ELR+Backbone=ResNet342022.02 | 77.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.8 | 60.8 | — | — | — | — | 77.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELR+Epoch Selection=Best2021.03 | 77.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.6 | 60.8 | 33.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELR2022.10 | 77.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.6 | 60.8 | 33.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELR+Advanced Training Config (SSL/Co-training/Pre-training)=true2021.11 | 77.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.6 | 60.8 | 33.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DivideMixEpoch Selection=Best2021.03 | 77.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 74.6 | 60.2 | 31.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DivideMixAdvanced Training Config (SSL/Co-training/Pre-training)=true2021.11 | 77.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 74.6 | 60.2 | 31.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DivideMixBackbone=ResNet342022.02 | 77.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 74.6 | 60.2 | — | — | — | — | 72.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ScanMixEpoch Selection=Best2021.03 | 77 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.7 | 66 | 58.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PropMix2022.10 | 76.99 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.71 | 66.75 | 58.32 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DivideMixEpoch Selection=Last2021.03 | 76.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 74.2 | 59.6 | 31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DivideMix2022.10 | 76.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 74.2 | 59.6 | 31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ours (Modified Model)Model Variant=Modified, Test-Time Augmentation=true2022.10 | 76.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 72.95 | 57.83 | 40.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Sel-CL+Backbone=PreAct ResNet-182022.03 | 76.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 72.4 | 59.6 | 48.8 | 78.7 | 77.5 | 76.4 | 74.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Sel-CL+2023.03 | 76.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 72.4 | 59.6 | 48.8 | — | — | — | — | — | — | — | — | — | 64.3 | — | — | — | — | — | — | — | — | — | |
| ELR (Uns-CL init.)Backbone=PreAct ResNet-18, initialization=Uns-CL2022.03 | 76.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 71.9 | 57.9 | 40.8 | 77.2 | 75.5 | 74.3 | 70.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ScanMixEpoch Selection=Last2021.03 | 76 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.4 | 65 | 58.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MOIT+Backbone=PreAct ResNet-182022.03 | 75.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.6 | 47.6 | 41.8 | 77.4 | 76.4 | 75.1 | 74 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MOIT+Epoch Selection=Best2021.03 | 75.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 51.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ours (Modified Model)Model Variant=Modified2022.10 | 75.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.86 | 57.03 | 39.95 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DivideMixBackbone=PreAct ResNet-182022.03 | 74.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 72.1 | 57.6 | 29.2 | 69.5 | 69.2 | 68.3 | 51 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DivideMix2023.03 | 74.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 72.1 | 57.6 | 29.2 | — | — | — | — | — | — | — | — | — | 58.4 | — | — | — | — | — | — | — | — | — | |
| ELRBackbone=PreAct ResNet-182022.03 | 74.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.2 | 45.2 | 20.5 | 75.8 | 74.8 | 73.6 | 70 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELR2023.03 | 74.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 70.2 | 45.2 | 20.5 | — | — | — | — | — | — | — | — | — | 52.6 | — | — | — | — | — | — | — | — | — | |
| PESEpoch Selection=Best2021.03 | 74.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 61.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| M-correctionEpoch Selection=Best2021.03 | 73.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 66.1 | 48.2 | 24.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LossModellingAdvanced Training Config (SSL/Co-training/Pre-training)=false2021.11 | 73.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 66.1 | 48.2 | 24.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| M-correctionBackbone=PreAct ResNet-182022.03 | 73.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.4 | 47.6 | 20.5 | 67.1 | 64.5 | 58.6 | 47.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| M-correctionEpoch Selection=Last2021.03 | 73.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.4 | 47.6 | 20.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| M-correction2023.03 | 73.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.4 | 47.6 | 20.5 | — | — | — | — | — | — | — | — | — | 51.7 | — | — | — | — | — | — | — | — | — | |
| MOIT2023.03 | 73 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 64.6 | 46.5 | 36 | — | — | — | — | — | — | — | — | — | 55 | — | — | — | — | — | — | — | — | — | |
| DRPLEpoch Selection=Best2021.03 | 71.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 53 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ours (Normal Model)Model Variant=Normal, Test-Time Augmentation=true2022.10 | 70.17 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.57 | 65.1 | 56.81 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixUpBackbone=ResNet342022.02 | 69.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 57.3 | 33.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PENCILEpoch Selection=Best2021.03 | 69.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 57.5 | 31.1 | 15.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PENCILAdvanced Training Config (SSL/Co-training/Pre-training)=false2021.11 | 69.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 57.5 | 31.1 | 15.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Ours (Normal Model)Model Variant=Normal2022.10 | 69.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 68.87 | 64.09 | 55.91 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Meta-LearningEpoch Selection=Best2021.03 | 68.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 59.2 | 42.4 | 19.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| P-correctionBackbone=PreAct ResNet-182022.03 | 68.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 56.4 | 20.7 | 8.8 | 76.1 | 68.9 | 59.3 | 48.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GCE (Uns-CL init.)Backbone=PreAct ResNet-18, initialization=Uns-CL2022.03 | 68.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 53.3 | 22.1 | 8.9 | 70.2 | 60.2 | 52.6 | 44.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| PENCILEpoch Selection=Last2021.03 | 68.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 56.4 | 20.7 | 8.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| P-correction2023.03 | 68.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 56.4 | 20.7 | 8.8 | — | — | — | — | — | — | — | — | — | 38.5 | — | — | — | — | — | — | — | — | — | |
| MixUpEpoch Selection=Best2021.03 | 67.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 57.3 | 30.8 | 14.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Meta-LearningEpoch Selection=Last2021.03 | 67.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 58 | 40.1 | 14.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixupBackbone=PreAct ResNet-182022.03 | 66 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 46.6 | 17.6 | 8.1 | 72.4 | 65.1 | 57.6 | 48.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MixUpEpoch Selection=Last2021.03 | 66 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 46.6 | 17.6 | 8.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Mixup2023.03 | 66 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 46.6 | 17.6 | 8.1 | — | — | — | — | — | — | — | — | — | 34.6 | — | — | — | — | — | — | — | — | — | |
| Coteaching+Epoch Selection=Best2021.03 | 65.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 51.8 | 27.9 | 13.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Co-teaching+Advanced Training Config (SSL/Co-training/Pre-training)=false2021.11 | 65.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 51.8 | 27.9 | 13.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Coteaching+Epoch Selection=Last2021.03 | 64.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 45.3 | 15.5 | 8.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-EntropyEpoch Selection=Best2021.03 | 62 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 46.7 | 19.9 | 10.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-EntropyAdvanced Training Config (SSL/Co-training/Pre-training)=false2021.11 | 62 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 46.7 | 19.9 | 10.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-EntropyBackbone=PreAct ResNet-182022.03 | 61.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 37.3 | 8.8 | 3.5 | 68.1 | 63.6 | 53.3 | 44.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-EntropyEpoch Selection=Last2021.03 | 61.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 37.3 | 8.8 | 3.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-Entropy2022.10 | 61.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 37.3 | 8.8 | 3.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-Entropy2023.03 | 61.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 37.3 | 8.8 | 3.5 | — | — | — | — | — | — | — | — | — | 27.8 | — | — | — | — | — | — | — | — | — | |
| F-correctionAdvanced Training Config (SSL/Co-training/Pre-training)=false2021.11 | 61.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 46.6 | 19.9 | 10.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ForwardBackbone=PreAct ResNet-182022.03 | 61.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 37.3 | 9 | 3.4 | 68.7 | 63.2 | 54.4 | 45.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| GCEBackbone=PreAct ResNet-182022.03 | 59.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 47.8 | 15.8 | 7.2 | 68 | 58.6 | 51.4 | 42.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CEBackbone=ResNet342022.02 | 58.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 47.1 | 23.8 | — | — | — | — | 43.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BBNimbalance_ratio=502021.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 39.4 | 36.48 | 26.89 | 21.08 | 16.77 | |
| CCEBackbone=ResNet-182018.05 | — | 58.72 | 37.41 | 19.12 | 8.99 | 66.54 | 59.2 | 51.4 | 42.74 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CORES22020.10 | — | — | — | — | — | — | — | — | — | — | — | — | — | 75.19 | 73.81 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Coteaching+Epoch selection=Best, Backbone=PRN182021.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.6 | 51.8 | 27.9 | 13.7 | — | — | — | — | — | — | — | — | — | — | — | |
| Coteaching+Epoch selection=Last, Backbone=PRN182021.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 64.1 | 45.3 | 15.5 | 8.8 | — | — | — | — | — | — | — | — | — | — | — | |
| Cross Entropy2020.10 | — | — | — | — | — | — | — | — | — | — | — | — | — | 59.2 | 51.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross Entropy Loss2019.03 | — | — | — | — | — | — | — | — | — | 58.72 | 48.2 | 37.41 | 18.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-EntropyEpoch selection=Best, Backbone=PRN182021.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 62 | 46.7 | 19.9 | 10.1 | — | — | — | — | — | — | — | — | — | — | — | |
| Cross-EntropyEpoch selection=Last, Backbone=PRN182021.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 61.8 | 37.3 | 8.8 | 3.5 | — | — | — | — | — | — | — | — | — | — | — | |
| CrossEntropyNoise type=Flip3, Implementation=Author's implementation2022.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 65.29 | 59.35 | 44 | 11.07 | — | — | — | — | — | |
| cRTimbalance_ratio=502021.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 35.7 | 30.23 | 24.37 | 19.9 | 17.47 | |
| DivideMixEpoch selection=Best, Backbone=PRN182021.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 77.3 | 74.6 | 60.2 | 31.5 | 59.1 | — | — | — | — | — | — | — | — | — | — | |
| DivideMixEpoch selection=Last, Backbone=PRN182021.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 76.9 | 74.2 | 59.6 | 31 | 53.5 | — | — | — | — | — | — | — | — | — | — | |
| ELR+Epoch selection=Best, Backbone=PRN182021.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 73.6 | 60.8 | 33.4 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ERMimbalance_ratio=502021.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 35.1 | 30.27 | 25.11 | 19.49 | 16.97 | |
| ERM-DRWimbalance_ratio=502021.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 37.74 | 32.63 | 27.19 | 21.43 | 17.52 | |
| Forward ^TBackbone=ResNet-182018.05 | — | 39.19 | 38.63 | 45.96 | 29.6 | 71.08 | 70.82 | 66.59 | 47.22 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Forward TBackbone=ResNet-182018.05 | — | 63.16 | 44.62 | 29.16 | 24.83 | 71.05 | 70.76 | 68.36 | 61.45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Forward Tground-truth noise transition matrix=not used2019.03 | — | — | — | — | — | — | — | — | — | 39.19 | 31.05 | 19.12 | 8.99 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Forward T2020.10 | — | — | — | — | — | — | — | — | — | — | — | — | — | 64.86 | 64.72 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Forward T*ground-truth noise transition matrix=used2019.03 | — | — | — | — | — | — | — | — | — | 63.16 | 54.65 | 44.62 | 24.83 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| HAR-DRWimbalance_ratio=502021.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 38.46 | 28.86 | 29.33 | 22.06 | 16.75 | |
| L2RTime (ms)=8392021.04 | — | — | — | — | — | — | — | — | — | 69.3 | 62.8 | 50.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| L2R + FaMUSTime (ms)=2442021.04 | — | — | — | — | — | — | — | — | — | 70.7 | 65.5 | 51.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LDAMimbalance_ratio=502021.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 39.94 | 33.43 | 30.01 | 23.3 | 17.51 | |
| LDAM-DRWimbalance_ratio=502021.08 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 42.88 | 36.6 | 33.12 | 25.91 | 19.48 | |
| LDMI2020.10 | — | — | — | — | — | — | — | — | — | — | — | — | — | 60.04 | 52.82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LongReMixEpoch selection=Best, Backbone=PRN182021.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 77.9 | 75.5 | 62.3 | 34.7 | 59.8 | — | — | — | — | — | — | — | — | — | — |