Medical Image Classification on DermaMNIST (m=5 synthetic annotators, K=7, test)
2.06ECEIR-Soft
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| IR-SoftBackbone=ViT-S/162026.03 | 2.06 | — | 1.87 | 4.57 | 0.626 | 1.423 | |
| IR-SoftBackbone=ResNet-182026.03 | 2.2 | — | 1.94 | 4.96 | 0.64 | 1.468 | |
| Dirichlet-SoftBackbone=ViT-S/162026.03 | 3.18 | — | 3 | 1.16 | 0.598 | 1.279 | |
| MCTS S=1Backbone=ViT-S/162026.03 | 3.28 | 5.04 | 2.71 | 3.16 | 0.609 | 1.346 | |
| SLTSBackbone=ViT-S/162026.03 | 3.29 | 5.03 | 2.74 | 3.15 | 0.609 | 1.346 | |
| SoftPlattBackbone=ViT-S/162026.03 | 3.41 | — | 3.05 | 1.36 | 0.599 | 1.287 | |
| Oracle TSBackbone=ViT-S/162026.03 | 3.51 | 4.94 | 2.97 | 3.13 | 0.609 | 1.346 | |
| VSBackbone=ViT-S/162026.03 | 3.81 | — | 3.35 | 2.73 | 0.609 | 1.329 | |
| Dirichlet-SoftBackbone=ResNet-182026.03 | 3.94 | — | 3.93 | 1.26 | 0.612 | 1.305 | |
| SoftPlattBackbone=ResNet-182026.03 | 4.05 | — | 3.8 | 1.51 | 0.614 | 1.313 | |
| VSBackbone=ResNet-182026.03 | 4.58 | — | 4.48 | 3.38 | 0.623 | 1.365 | |
| Oracle TSBackbone=ResNet-182026.03 | 4.87 | 3.38 | 4.49 | 3.97 | 0.628 | 1.388 | |
| LS-TSBackbone=ResNet-182026.03 | 5.05 | 3.03 | 4.82 | 3.79 | 0.63 | 1.394 | |
| MCTS S=1Backbone=ResNet-182026.03 | 5.07 | 3.42 | 4.74 | 4.02 | 0.629 | 1.388 | |
| SLTSBackbone=ResNet-182026.03 | 5.13 | 3.43 | 4.76 | 4.02 | 0.629 | 1.388 | |
| LS-TSBackbone=ViT-S/162026.03 | 7.36 | 4.19 | 7.06 | 3.68 | 0.615 | 1.362 | |
| TSBackbone=ResNet-182026.03 | 22.25 | 1.84 | 22.2 | 6.91 | 0.687 | 1.637 | |
| ATSBackbone=ResNet-182026.03 | 22.82 | 1.86 | 22.75 | 6.97 | 0.687 | 1.606 | |
| Dirichlet-HardBackbone=ResNet-182026.03 | 23.02 | — | 22.79 | 7.06 | 0.683 | 1.704 | |
| PlattBackbone=ResNet-182026.03 | 23.1 | — | 23.03 | 6.93 | 0.682 | 1.623 | |
| PlattBackbone=ViT-S/162026.03 | 24.18 | — | 24.02 | 7.13 | 0.675 | 1.67 | |
| Dirichlet-HardBackbone=ViT-S/162026.03 | 24.55 | — | 24.46 | 7.33 | 0.68 | 1.877 | |
| TSBackbone=ViT-S/162026.03 | 24.65 | 2.55 | 24.57 | 7.3 | 0.683 | 1.664 | |
| ATSBackbone=ViT-S/162026.03 | 25.35 | 2.53 | 25.24 | 7.53 | 0.686 | 1.65 | |
| UncalibratedBackbone=ResNet-182026.03 | 34.56 | — | 34.51 | 10.11 | 0.771 | 2.617 | |
| UncalibratedBackbone=ViT-S/162026.03 | 37.55 | — | 37.48 | 10.88 | 0.791 | 3.7 |