Image Classification on CIFAR-10 Symmetric Noise (test)
93.6Test Accuracy (Overall)Joint Optimization Framework
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Joint Optimization Frameworknoise rate (%)=0, selection=last2018.03 | 93.6 | — | — | — | — | — | 99.9 | — | — | — | |
| NLSSmooth Rate=-0.42021.06 | 93.55 | — | — | — | — | — | — | — | — | — | |
| Cross Entropy Lossnoise rate (%)=0, selection=best2018.03 | 93.5 | — | — | — | — | — | 100 | — | — | — | |
| Cross Entropy Lossnoise rate (%)=0, selection=last2018.03 | 93.4 | — | — | — | — | — | 100 | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=0, selection=best2018.03 | 93.4 | — | — | — | — | — | 100 | — | — | — | |
| NLSSmooth Rate=-2.02021.06 | 93.3 | — | — | — | — | — | — | — | — | — | |
| NLSSmooth Rate=-6.02021.06 | 93.14 | — | — | — | — | — | — | — | — | — | |
| NLSSmooth Rate=-4.02021.06 | 93.13 | — | — | — | — | — | — | — | — | — | |
| Label SmoothingSmooth Rate=0.42021.06 | 93.05 | — | — | — | — | — | — | — | — | — | |
| Label SmoothingSmooth Rate=0.82021.06 | 92.91 | — | — | — | — | — | — | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=10, selection=last2018.03 | 92.9 | — | — | — | — | — | 98.1 | — | — | — | |
| NLSSmooth Rate=-0.82021.06 | 92.74 | — | — | — | — | — | — | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=10, selection=best2018.03 | 92.7 | — | — | — | — | — | 97.9 | — | — | — | |
| NLSSmooth Rate=-1.02021.06 | 92.58 | — | — | — | — | — | — | — | — | — | |
| ELRBackbone=ResNet-34, Noise Rate (epsilon)=0.22021.06 | 92.57 | — | — | — | — | — | — | — | — | — | |
| Label SmoothingSmooth Rate=0.62021.06 | 92.33 | — | — | — | — | — | — | — | — | — | |
| AUMBackbone=ResNet-34, Noise Rate (epsilon)=0.22021.06 | 91.52 | — | — | — | — | — | — | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=30, selection=last2018.03 | 91.5 | — | — | — | — | — | 95.1 | — | — | — | |
| Hard LabelSmooth Rate=0.02021.06 | 91.44 | — | — | — | — | — | — | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=30, selection=best2018.03 | 91.4 | — | — | — | — | — | 95.1 | — | — | — | |
| ELRBackbone=ResNet-34, Noise Rate (epsilon)=0.42021.06 | 91.32 | — | — | — | — | — | — | — | — | — | |
| Cross Entropy Lossnoise rate (%)=10, selection=best2018.03 | 91 | — | — | — | — | — | 96.4 | — | — | — | |
| Label Smoothing (LS)Backbone=ResNet-34, Noise Rate (epsilon)=0.22021.06 | 90.24 | — | — | — | — | — | — | — | — | — | |
| Peer LossBackbone=ResNet-34, Noise Rate (epsilon)=0.22021.06 | 90.21 | — | — | — | — | — | — | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=50, selection=last2018.03 | 89.8 | — | — | — | — | — | 91.8 | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=50, selection=best2018.03 | 89.6 | — | — | — | — | — | 91.7 | — | — | — | |
| SCEBackbone=ResNet-34, Noise Rate (epsilon)=0.22021.06 | 89.39 | — | — | — | — | — | — | — | — | — | |
| Negative/Not Label Smoothing (NLS)Backbone=ResNet-34, Noise Rate (epsilon)=0.22021.06 | 89.05 | — | — | — | — | — | — | — | — | — | |
| ELRBackbone=ResNet-34, Noise Rate (epsilon)=0.62021.06 | 88.86 | — | — | — | — | — | — | — | — | — | |
| APLBackbone=ResNet-34, Noise Rate (epsilon)=0.22021.06 | 88.42 | — | — | — | — | — | — | — | — | — | |
| Cross Entropy Lossnoise rate (%)=30, selection=best2018.03 | 88.4 | — | — | — | — | — | 92.7 | — | — | — | |
| AUMBackbone=ResNet-34, Noise Rate (epsilon)=0.42021.06 | 87.85 | — | — | — | — | — | — | — | — | — | |
| Cross Entropy Lossnoise rate (%)=10, selection=last2018.03 | 87 | — | — | — | — | — | 91.1 | — | — | — | |
| Cross EntropyBackbone=ResNet-34, Noise Rate (epsilon)=0.22021.06 | 86.45 | — | — | — | — | — | — | — | — | — | |
| Peer LossBackbone=ResNet-34, Noise Rate (epsilon)=0.42021.06 | 86.4 | — | — | — | — | — | — | — | — | — | |
| BootstrapBackbone=ResNet-34, Noise Rate (epsilon)=0.22021.06 | 86.06 | — | — | — | — | — | — | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=70, selection=last2018.03 | 86 | — | — | — | — | — | 86.4 | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=70, selection=best2018.03 | 85.9 | — | — | — | — | — | 86.3 | — | — | — | |
| Cross Entropy Lossnoise rate (%)=50, selection=best2018.03 | 85 | — | — | — | — | — | 88.2 | — | — | — | |
| FLCBackbone=ResNet-34, Noise Rate (epsilon)=0.42021.06 | 84.98 | — | — | — | — | — | — | — | — | — | |
| FLCBackbone=ResNet-34, Noise Rate (epsilon)=0.22021.06 | 84.85 | — | — | — | — | — | — | — | — | — | |
| Negative/Not Label Smoothing (NLS)Backbone=ResNet-34, Noise Rate (epsilon)=0.42021.06 | 84.85 | — | — | — | — | — | — | — | — | — | |
| Label Smoothing (LS)Backbone=ResNet-34, Noise Rate (epsilon)=0.42021.06 | 83.78 | — | — | — | — | — | — | — | — | — | |
| Cross EntropyBackbone=ResNet-34, Noise Rate (epsilon)=0.42021.06 | 82.72 | — | — | — | — | — | — | — | — | — | |
| AUMBackbone=ResNet-34, Noise Rate (epsilon)=0.62021.06 | 81.71 | — | — | — | — | — | — | — | — | — | |
| BootstrapBackbone=ResNet-34, Noise Rate (epsilon)=0.42021.06 | 81.65 | — | — | — | — | — | — | — | — | — | |
| APLBackbone=ResNet-34, Noise Rate (epsilon)=0.42021.06 | 81.27 | — | — | — | — | — | — | — | — | — | |
| SCEBackbone=ResNet-34, Noise Rate (epsilon)=0.42021.06 | 80.31 | — | — | — | — | — | — | — | — | — | |
| Peer LossBackbone=ResNet-34, Noise Rate (epsilon)=0.62021.06 | 79.64 | — | — | — | — | — | — | — | — | — | |
| Cross Entropy Lossnoise rate (%)=70, selection=best2018.03 | 78.4 | — | — | — | — | — | 80.1 | — | — | — | |
| Negative/Not Label Smoothing (NLS)Backbone=ResNet-34, Noise Rate (epsilon)=0.62021.06 | 77.82 | — | — | — | — | — | — | — | — | — | |
| APLBackbone=ResNet-34, Noise Rate (epsilon)=0.62021.06 | 76.62 | — | — | — | — | — | — | — | — | — | |
| SCEBackbone=ResNet-34, Noise Rate (epsilon)=0.62021.06 | 75.28 | — | — | — | — | — | — | — | — | — | |
| BootstrapBackbone=ResNet-34, Noise Rate (epsilon)=0.62021.06 | 75.26 | — | — | — | — | — | — | — | — | — | |
| Label Smoothing (LS)Backbone=ResNet-34, Noise Rate (epsilon)=0.62021.06 | 75.01 | — | — | — | — | — | — | — | — | — | |
| Cross EntropyBackbone=ResNet-34, Noise Rate (epsilon)=0.62021.06 | 74.04 | — | — | — | — | — | — | — | — | — | |
| FLCBackbone=ResNet-34, Noise Rate (epsilon)=0.62021.06 | 73.97 | — | — | — | — | — | — | — | — | — | |
| Cross Entropy Lossnoise rate (%)=30, selection=last2018.03 | 72.2 | — | — | — | — | — | 74.6 | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=90, selection=last2018.03 | 58.3 | — | — | — | — | — | 58.3 | — | — | — | |
| Joint Optimization Frameworknoise rate (%)=90, selection=best2018.03 | 58 | — | — | — | — | — | 58.2 | — | — | — | |
| Cross Entropy Lossnoise rate (%)=50, selection=last2018.03 | 55.3 | — | — | — | — | — | 57.6 | — | — | — | |
| Cross Entropy Lossnoise rate (%)=90, selection=best2018.03 | 41.1 | — | — | — | — | — | 41.4 | — | — | — | |
| Cross Entropy Lossnoise rate (%)=70, selection=last2018.03 | 36.6 | — | — | — | — | — | 39.6 | — | — | — | |
| Cross Entropy Lossnoise rate (%)=90, selection=last2018.03 | 20.4 | — | — | — | — | — | 21.7 | — | — | — | |
| AugDescNoise ratio=20%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 96.3 | |
| AugDescNoise ratio=50%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 95.4 | |
| AugDescNoise ratio=80%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 93.8 | |
| AugDescNoise ratio=90%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 91.9 | |
| C2Depoch_selection=Best2021.11 | — | — | — | 95.5 | — | 93.2 | — | 96.4 | 94.3 | — | |
| C2DNoise ratio=20%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 96.3 | |
| C2DNoise ratio=50%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 95.2 | |
| C2DNoise ratio=80%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 94.4 | |
| C2DNoise ratio=90%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 93.5 | |
| Co-teaching+Noise ratio=20%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 89.5 | |
| Co-teaching+Noise ratio=50%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 85.7 | |
| Co-teaching+Noise ratio=80%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 67.4 | |
| Co-teaching+Noise ratio=90%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 47.9 | |
| CoDiM-bareepoch_selection=Best, configuration=only pre-training2021.11 | — | — | — | 95.5 | — | 93.4 | — | 96.4 | 94.6 | — | |
| CoDiM-CSSLepoch_selection=Best, configuration=add SelfCon on I2021.11 | — | — | — | 96.1 | — | 93.5 | — | 96.5 | 94.6 | — | |
| CoDiM-Selfepoch_selection=Best2021.11 | — | — | — | 95.3 | — | 92.9 | — | 96.5 | 94.3 | — | |
| CoDiM-Supepoch_selection=Best2021.11 | — | — | — | 96.5 | — | 93.7 | — | 97 | 94.7 | — | |
| Cross Entropy Lossepoch_selection=best, trials=52019.03 | — | 91.66 | 89 | 85.15 | 78.09 | 50.74 | — | — | — | — | |
| Cross Entropy Lossepoch_selection=last, trials=52019.03 | — | 88.43 | 72.78 | 53.11 | 33.32 | 16.3 | — | — | — | — | |
| Cross-Entropyepoch_selection=Best2021.11 | — | — | — | 79.4 | — | 42.7 | — | 86.8 | 62.9 | — | |
| Cross-Entropyepoch_selection=Last2021.11 | — | — | — | 57.9 | — | 16.8 | — | 82.7 | 26.1 | — | |
| Cross-Entropy (CE)Noise ratio=20%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 86.8 | |
| Cross-Entropy (CE)Noise ratio=50%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 79.4 | |
| Cross-Entropy (CE)Noise ratio=80%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 62.9 | |
| Cross-Entropy (CE)Noise ratio=90%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 42.7 | |
| DivideMixepoch_selection=Best2021.11 | — | — | — | 94.6 | — | 76 | — | 96.1 | 93.2 | — | |
| DivideMixNoise ratio=20%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 96.1 | |
| DivideMixNoise ratio=50%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 94.6 | |
| DivideMixNoise ratio=80%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 93.2 | |
| DivideMixNoise ratio=90%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 76 | |
| DM-AugDescepoch_selection=Best2021.11 | — | — | — | 95.4 | — | 91.9 | — | 96.3 | 93.8 | — | |
| GCENoise ratio=20%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 90 | |
| GCENoise ratio=50%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 89.3 | |
| GCENoise ratio=80%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 73.9 | |
| GCENoise ratio=90%, Noise type=Symmetric2023.02 | — | — | — | — | — | — | — | — | — | 36.5 | |
| M-correctionepoch_selection=Best2021.11 | — | — | — | 92 | — | 69.1 | — | 94 | 86.8 | — |