Image Classification on CIFAR-10 LT (Accuracy)
85.3AccuracySEVAL
Evaluation results
| Method | Links | |
|---|---|---|
| SEVALLTL=true, PLR=true, THA=true, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 85.3 | |
| MetaExpertLTL=true, PLR=true, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 84.4 | |
| ABCLTL=true, PLR=true, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 83.8 | |
| ACRLTL=true, PLR=true, THA=true, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 83.8 | |
| SEVALLTL=true, PLR=true, THA=true, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 82.8 | |
| MetaExpertLTL=true, PLR=true, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 80.9 | |
| ACRLTL=true, PLR=true, THA=true, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 80.2 | |
| SAWLTL=true, PLR=true, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 80.1 | |
| SEVAL-PLLTL=false, PLR=true, THA=true, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 79.7 | |
| DASOLTL=true, PLR=true, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 79.1 | |
| ABCLTL=true, PLR=true, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 78.9 | |
| SimProLTL=true, PLR=true, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 78.8 | |
| FedLCSkewness (δ)=0.5, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 78.34 | |
| FlexMatchLTL=false, PLR=true, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 78.2 | |
| FedBBSkewness (δ)=0.5, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 78.17 | |
| CReST+LTL=true, PLR=true, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 78.1 | |
| DARPLTL=false, PLR=true, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 77.8 | |
| FreeMatchLTL=false, PLR=true, THA=true, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 77.7 | |
| SEVAL-PLLTL=false, PLR=true, THA=true, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 77.7 | |
| FixMatchLTL=false, PLR=false, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 77.5 | |
| AdshLTL=false, PLR=true, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 77.2 | |
| MOONSkewness (δ)=0.5, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 77.16 | |
| CSDMImbalance Factor=10, IPC=502026.03 | 76.5 | |
| FedAvgSkewness (δ)=0.5, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 76.32 | |
| CReST+LTL=true, PLR=true, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 76.3 | |
| Full DatasetImbalance Factor=102026.03 | 76.2 | |
| DASOLTL=true, PLR=true, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 76 | |
| FedNovaSkewness (δ)=0.5, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 75.67 | |
| NCFMImbalance Factor=10, IPC=502026.03 | 75.6 | |
| SAWLTL=true, PLR=true, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 74.6 | |
| DARPLTL=false, PLR=true, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 74.5 | |
| FedProxSkewness (δ)=0.5, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 74.16 | |
| FlexMatchLTL=false, PLR=true, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 74 | |
| CSDMImbalance Factor=10, IPC=202026.03 | 73.9 | |
| FreeMatchLTL=false, PLR=true, THA=true, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 73.8 | |
| CSDMImbalance Factor=50, IPC=502026.03 | 73.4 | |
| AdshLTL=false, PLR=true, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 73 | |
| FedAlignSkewness (δ)=0.5, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 72.99 | |
| NCFMImbalance Factor=50, IPC=502026.03 | 72.2 | |
| CSDMImbalance Factor=50, IPC=202026.03 | 71.6 | |
| NCFMImbalance Factor=50, IPC=202026.03 | 71.3 | |
| NCFMImbalance Factor=10, IPC=202026.03 | 71.2 | |
| CSDMImbalance Factor=10, IPC=102026.03 | 71 | |
| CSDMImbalance Factor=100, IPC=502026.03 | 71 | |
| LALTL=true, PLR=false, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 70.6 | |
| LADImbalance Factor=10, IPC=502026.03 | 70.5 | |
| NCFMImbalance Factor=10, IPC=102026.03 | 70.2 | |
| CSDMImbalance Factor=100, IPC=202026.03 | 69.4 | |
| CSDMImbalance Factor=50, IPC=102026.03 | 69.3 | |
| NCFMImbalance Factor=50, IPC=102026.03 | 68.8 | |
| SimProLTL=true, PLR=true, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 68.4 | |
| FixMatchLTL=false, PLR=false, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 67.8 | |
| CSDMImbalance Factor=100, IPC=102026.03 | 67.4 | |
| CSDMImbalance Factor=200, IPC=502026.03 | 66.8 | |
| DATMImbalance Factor=10, IPC=502026.03 | 66.7 | |
| CSDMImbalance Factor=200, IPC=202026.03 | 66.1 | |
| LADImbalance Factor=50, IPC=502026.03 | 65.8 | |
| CSDMImbalance Factor=200, IPC=102026.03 | 65.3 | |
| FedBBSkewness (δ)=0.1, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 64.3 | |
| LADImbalance Factor=100, IPC=502026.03 | 64 | |
| LADImbalance Factor=10, IPC=202026.03 | 63 | |
| RDEDImbalance Factor=10, IPC=502026.03 | 63 | |
| FedLCSkewness (δ)=0.1, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 63 | |
| LADImbalance Factor=200, IPC=502026.03 | 62.3 | |
| FedProxSkewness (δ)=0.1, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 62.02 | |
| MTTImbalance Factor=10, IPC=502026.03 | 62 | |
| SupervisedLTL=false, PLR=false, THA=false, n1=1500, m1=3000, gamma_X=100, gamma_U=1002024.07 | 61.9 | |
| Full DatasetImbalance Factor=502026.03 | 61.2 | |
| DATMImbalance Factor=10, IPC=202026.03 | 60.4 | |
| NCFMImbalance Factor=100, IPC=102026.03 | 60.4 | |
| IDMImbalance Factor=10, IPC=502026.03 | 60.1 | |
| NCFMImbalance Factor=100, IPC=202026.03 | 60.1 | |
| FedAlignSkewness (δ)=0.1, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 59.92 | |
| MTTImbalance Factor=10, IPC=202026.03 | 59.5 | |
| LADImbalance Factor=50, IPC=202026.03 | 59.4 | |
| NCFMImbalance Factor=100, IPC=502026.03 | 59.3 | |
| LADImbalance Factor=100, IPC=202026.03 | 58.2 | |
| MOONSkewness (δ)=0.1, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 58.14 | |
| LADImbalance Factor=10, IPC=102026.03 | 58.1 | |
| MTTImbalance Factor=10, IPC=102026.03 | 58 | |
| FedAvgSkewness (δ)=0.1, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 57.81 | |
| NCFMImbalance Factor=200, IPC=102026.03 | 57.7 | |
| FedNovaSkewness (δ)=0.1, Number of clients (K)=10, Local training epochs=10, Model aggregation epochs=202026.06 | 57.54 | |
| DATMImbalance Factor=10, IPC=102026.03 | 57.2 | |
| IDMImbalance Factor=10, IPC=202026.03 | 57.1 | |
| NCFMImbalance Factor=200, IPC=202026.03 | 57 | |
| LADImbalance Factor=200, IPC=202026.03 | 56.6 | |
| IDMImbalance Factor=50, IPC=502026.03 | 56.1 | |
| NCFMImbalance Factor=200, IPC=502026.03 | 56.1 | |
| RDEDImbalance Factor=10, IPC=202026.03 | 55 | |
| IDMImbalance Factor=10, IPC=102026.03 | 54.8 | |
| Full DatasetImbalance Factor=1002026.03 | 54.8 | |
| LADImbalance Factor=50, IPC=102026.03 | 54.2 | |
| MTTImbalance Factor=50, IPC=502026.03 | 53.6 | |
| LADImbalance Factor=100, IPC=102026.03 | 53.4 | |
| IDMImbalance Factor=50, IPC=202026.03 | 53.3 | |
| LALTL=true, PLR=false, THA=false, n1=500, m1=4000, gamma_X=100, gamma_U=1002024.07 | 53.3 | |
| IDMImbalance Factor=100, IPC=502026.03 | 53.1 | |
| RDEDImbalance Factor=50, IPC=502026.03 | 52.9 | |
| RandomImbalance Factor=100, IPC=502026.03 | 52.6 |