Multi-label structural damage classification on xROAD 20-class setting 1.0 (test)
42.77AccuracySCAFFOLD
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SCAFFOLDNumber of Clusters (M)=1 (no clustering), Backbone=ResNet-182026.06 | 42.77 | 64.11 | 45.75 | 53.4 | |
| MOONNumber of Clusters (M)=3, Backbone=ResNet-182026.06 | 42.3 | 64.63 | 50.36 | 56.61 | |
| LocalNumber of Clusters (M)=/, Backbone=ResNet-182026.06 | 41.44 | 45.01 | 60.79 | 51.72 | |
| Clustered-DRAPRNumber of Clusters (M)=2, Backbone=ResNet-182026.06 | 40.74 | 67.5 | 51.92 | 58.69 | |
| IFCANumber of Clusters (M)=2, Backbone=ResNet-182026.06 | 40.7 | 65.57 | 49 | 56.09 | |
| FedProxNumber of Clusters (M)=3, Backbone=ResNet-182026.06 | 40.69 | 65.22 | 49.29 | 56.15 | |
| Clustered-DRAPRNumber of Clusters (M)=3, Backbone=ResNet-182026.06 | 40.66 | 68.11 | 52.13 | 59.06 | |
| FedProxNumber of Clusters (M)=2, Backbone=ResNet-182026.06 | 40.53 | 65.39 | 49.26 | 56.19 | |
| IFCANumber of Clusters (M)=3, Backbone=ResNet-182026.06 | 40.52 | 65.47 | 49.17 | 56.16 | |
| MOONNumber of Clusters (M)=2, Backbone=ResNet-182026.06 | 40.37 | 65.51 | 47.68 | 55.19 | |
| Clustered-DRAPRNumber of Clusters (M)=1 (no clustering), Backbone=ResNet-182026.06 | 40.3 | 65.75 | 48.23 | 55.64 | |
| MOONNumber of Clusters (M)=1 (no clustering), Backbone=ResNet-182026.06 | 40.25 | 64.79 | 47.56 | 54.85 | |
| FedProxNumber of Clusters (M)=1 (no clustering), Backbone=ResNet-182026.06 | 39.98 | 65.9 | 47.94 | 55.5 | |
| FedAvgNumber of Clusters (M)=3, Backbone=ResNet-182026.06 | 39.49 | 64.63 | 47.42 | 54.7 | |
| SCAFFOLDNumber of Clusters (M)=2, Backbone=ResNet-182026.06 | 39.43 | 65.57 | 46.19 | 54.2 | |
| FedAvgNumber of Clusters (M)=2, Backbone=ResNet-182026.06 | 39.24 | 65.78 | 45.82 | 54.01 | |
| FedAvgNumber of Clusters (M)=1 (no clustering), Backbone=ResNet-182026.06 | 38.71 | 66.06 | 44.65 | 53.28 | |
| SCAFFOLDNumber of Clusters (M)=3, Backbone=ResNet-182026.06 | 38.46 | 65.19 | 45.64 | 53.69 |