DermaMNIST
Benchmarks
TaskDatasetSOTA resultTrendResults
DermaMNIST
83.6Accuracy
63
DermaMNIST
86.2Accuracy
62
DermaMNIST (test)
0.366L1 ECEKDE
32
DermaMNIST m=5 synthetic annotators, K=7, mean agreement 64.7% (test)
2.06ECE
26
DermaMNIST (test)
2.32Brier Score
19
DermaMNIST (test)
91.83Macro AUC
16
DermaMNIST (val)
79.26Accuracy
12
DermaMNIST v2 (test)
91.35AUCOC
11
DermaMNIST 40% Noise
98.7Sensitivity
10
DermaMNIST 20% Noise
97.7Sensitivity
10
DermaMNIST 0% Noise
97.7Sensitivity
10
DermaMNIST Mild Non-IID alpha=1.0
74.32Accuracy
8
DermaMNIST 7-class (test)
73.46Accuracy
8
DermaMNIST
65.45Base Accuracy
7
DermaMNIST v=2 (test)
86.82Accuracy
7
DermaMNIST Linear Evaluation 100% ratio
85.14Accuracy
7
DermaMNIST 10% ratio Linear Evaluation
79.1Accuracy
7
DermaMNIST Linear Evaluation 1% ratio
70.87Accuracy
7
dermamnist
0.3Δ Accuracy (pp)
6
DermaMNIST 50% removal binary (test)
87Specificity
5
DermaMNIST 20% removal binary (test)
90Specificity
5
DermaMNIST 28x28 (val)
89.04AUC
3
DermaMNIST Retained v2 (test)
91.41Accuracy
3
DermaMNIST v2 (test)
79.74Accuracy
3
DermaMNIST
0.937AUC
3