Class-Incremental Learning on CIFAR-100 (test) with Accuracy and Calibration Metrics
69.98AccuracyDER
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DERCIL Method=DER, Cal Method=Vanilla2025.03 | 69.98 | 22.38 | 22.35 | — | |
| DER + TSCIL Method=DER, Cal Method=TS2025.03 | 69.98 | 6.16 | 6.04 | — | |
| DER + ETSCIL Method=DER, Cal Method=ETS2025.03 | 69.98 | 6.12 | 6.03 | — | |
| DER + IRMCIL Method=DER, Cal Method=IRM2025.03 | 69.98 | 7.88 | 8.03 | — | |
| DER + PerturbTSCIL Method=DER, Cal Method=PerturbTS2025.03 | 69.98 | 52.21 | 52.21 | — | |
| DER + T-CILCIL Method=DER, Cal Method=T-CIL2025.03 | 69.98 | 4.37 | 4.34 | — | |
| WACIL Method=WA, Cal Method=Vanilla2025.03 | 64.34 | 8.89 | 8.86 | — | |
| WA + TSCIL Method=WA, Cal Method=TS2025.03 | 64.02 | 5.93 | 5.88 | — | |
| WA + ETSCIL Method=WA, Cal Method=ETS2025.03 | 64.02 | 5.77 | 5.75 | — | |
| WA + IRMCIL Method=WA, Cal Method=IRM2025.03 | 64.02 | 6.61 | 6.51 | — | |
| WA + PerturbTSCIL Method=WA, Cal Method=PerturbTS2025.03 | 64.02 | 46.55 | 46.54 | — | |
| WA + T-CILCIL Method=WA, Cal Method=T-CIL2025.03 | 64.02 | 3.87 | 3.84 | — | |
| EEIL + TSCIL Method=EEIL, Cal Method=TS2025.03 | 60.74 | 13.25 | 13.14 | — | |
| EEIL + ETSCIL Method=EEIL, Cal Method=ETS2025.03 | 60.74 | 13.89 | 13.83 | — | |
| EEIL + IRMCIL Method=EEIL, Cal Method=IRM2025.03 | 60.74 | 15.2 | 15.09 | — | |
| EEIL + PerturbTSCIL Method=EEIL, Cal Method=PerturbTS2025.03 | 60.74 | 40.34 | 40.34 | — | |
| EEIL + T-CILCIL Method=EEIL, Cal Method=T-CIL2025.03 | 60.74 | 10.3 | 10.22 | — | |
| EEILCIL Method=EEIL, Cal Method=Vanilla2025.03 | 60.61 | 21.96 | 21.94 | — | |
| VanillaCalibration Method=None, Backbone=ResNet-32, Base CIL method=ER, Number of incremental tasks=10, Memory size=2000, Batch size=1282025.03 | 56.51 | 27.66 | 27.64 | — | |
| ERCIL Method=ER, Cal Method=Vanilla2025.03 | 56.51 | 27.66 | 27.64 | — | |
| TSCalibration Method=Temperature Scaling, Backbone=ResNet-32, Base CIL method=ER, Number of incremental tasks=10, Memory size=2000, Batch size=1282025.03 | 56.25 | 16.28 | 16.22 | — | |
| ETSCalibration Method=Ensemble Temperature Scaling, Backbone=ResNet-32, Base CIL method=ER, Number of incremental tasks=10, Memory size=2000, Batch size=1282025.03 | 56.25 | 16.83 | 16.8 | — | |
| IRMCalibration Method=Isotonic Regression, Backbone=ResNet-32, Base CIL method=ER, Number of incremental tasks=10, Memory size=2000, Batch size=1282025.03 | 56.25 | 17.5 | 17.39 | — | |
| PerturbTSCalibration Method=Perturbed Temperature Scaling, Backbone=ResNet-32, Base CIL method=ER, Number of incremental tasks=10, Memory size=2000, Batch size=1282025.03 | 56.25 | 16.49 | 16.49 | — | |
| T-CILCalibration Method=T-CIL, Backbone=ResNet-32, Base CIL method=ER, Number of incremental tasks=10, Memory size=2000, Batch size=1282025.03 | 56.25 | 5.74 | 5.75 | — | |
| ER + TSCIL Method=ER, Cal Method=TS2025.03 | 56.25 | 16.28 | 16.22 | — | |
| ER + ETSCIL Method=ER, Cal Method=ETS2025.03 | 56.25 | 16.83 | 16.8 | — | |
| ER + IRMCIL Method=ER, Cal Method=IRM2025.03 | 56.25 | 17.5 | 17.39 | — | |
| ER + PerturbTSCIL Method=ER, Cal Method=PerturbTS2025.03 | 56.25 | 16.49 | 16.49 | — | |
| ER + T-CILCIL Method=ER, Cal Method=T-CIL2025.03 | 56.25 | 5.74 | 5.75 | — | |
| DER++buffer size=1000, single-pass=true, seeds=52026.05 | — | — | — | 6.93 | |
| ERbuffer size=1000, single-pass=true, seeds=52026.05 | — | — | — | 6.55 | |
| ER-ACEbuffer size=1000, single-pass=true, seeds=52026.05 | — | — | — | 11.3 | |
| FTreplay=false, buffer size=1000, single-pass=true, seeds=52026.05 | — | — | — | 1.65 | |
| GDUMBbuffer size=1000, single-pass=true, seeds=52026.05 | — | — | — | 4.57 | |
| iCaRLbuffer size=1000, single-pass=true, seeds=52026.05 | — | — | — | 1.22 | |
| LODEbuffer size=1000, single-pass=true, seeds=52026.05 | — | — | — | 13.3 | |
| LUCIRbuffer size=1000, single-pass=true, seeds=52026.05 | — | — | — | 2.77 | |
| MANGObuffer size=1000, single-pass=true, seeds=52026.05 | — | — | — | 20.25 |