Dataset Distillation on CIFAR-100 (test)
56.2AccuracyFull Dataset
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Full DatasetImg/Cls=12022.12 | 56.2 | — | — | — | — | — | — | — | — | — | |
| Full DatasetImg/Cls=102022.12 | 56.2 | — | — | — | — | — | — | — | — | — | |
| Full DatasetImg/Cls=502022.12 | 56.2 | — | — | — | — | — | — | — | — | — | |
| SelMatchModel Arch.=ResNet18, IPC=1002026.03 | 55.4 | — | — | — | 83 | 91 | 27.5 | — | 62 | 927.3 | |
| SelMatchModel Arch.=ConvNet, IPC=1002026.03 | 54.8 | — | — | — | 82 | 89 | 28.5 | — | 62 | 924.5 | |
| DATMModel Arch.=ResNet18, IPC=1002026.03 | 54.2 | — | — | — | 81 | 89 | 25.9 | — | 63 | 930.4 | |
| SelMatchModel Arch.=VGG11-BN, IPC=1002026.03 | 53.3 | — | — | — | 82 | 89 | 18.1 | — | 60 | 936 | |
| Ours5Img/Cls=502022.12 | 52.6 | 42 | 4.97 | 1.1 | — | — | — | — | — | — | |
| DATMModel Arch.=VGG11-BN, IPC=1002026.03 | 52.5 | — | — | — | 81 | 89 | 26.5 | — | 62 | 966.3 | |
| SelMatchModel Arch.=AlexNet, IPC=1002026.03 | 52.3 | — | — | — | 81 | 89 | 25.4 | — | 61 | 956.3 | |
| Ours10Img/Cls=502022.12 | 52.2 | 21 | 9.96 | 1.09 | — | — | — | — | — | — | |
| Ours20Img/Cls=502022.12 | 52.1 | 10.5 | 19.9 | 1.07 | — | — | — | — | — | — | |
| DATMModel Arch.=ConvNet, IPC=1002026.03 | 51.3 | — | — | — | 82 | 90 | 30.1 | — | 61 | 987.3 | |
| FTDipc=50, backbone=ConvNet-32022.11 | 50.7 | — | — | — | — | — | — | — | — | — | |
| DATMModel Arch.=AlexNet, IPC=1002026.03 | 50.5 | — | — | — | 80 | 88 | 16.1 | — | 62 | 954.1 | |
| SelMatchModel Arch.=VGG11-BN, IPC=502026.03 | 49.7 | — | — | — | 79 | 87 | 17.1 | — | 58 | 1,014.2 | |
| SelMatchModel Arch.=ResNet18, IPC=502026.03 | 49.3 | — | — | — | 80 | 88 | 21.7 | — | 60 | 988.6 | |
| PPipc=50, backbone=ConvNet-32022.11 | 48.4 | — | — | — | — | — | — | — | — | — | |
| SelMatchModel Arch.=ConvNet, IPC=502026.03 | 48.1 | — | — | — | 79 | 87 | 23.3 | — | 59 | 991.3 | |
| MTT+Robust Learningipc=50, backbone=ConvNet-32022.11 | 47.9 | — | — | — | — | — | — | — | — | — | |
| MTTipc=50, backbone=ConvNet-32022.11 | 47.7 | — | — | — | — | — | — | — | — | — | |
| TMImg/Cls=502022.12 | 47.7 | — | 14.7 | 0.92 | — | — | — | — | — | — | |
| SelMatchModel Arch.=AlexNet, IPC=502026.03 | 46.7 | — | — | — | 78 | 86 | 17.8 | — | 58 | 1,003.5 | |
| SeqMatchModel Arch.=ResNet18, IPC=1002026.03 | 45.9 | — | — | — | 78 | 86 | 20.9 | — | 58 | 1,035.4 | |
| Ours5Img/Cls=102022.12 | 45.6 | 25.6 | 4.97 | 1.1 | — | — | — | — | — | — | |
| Ours10Img/Cls=102022.12 | 45.2 | 12.8 | 9.96 | 1.09 | — | — | — | — | — | — | |
| IDCImg/Cls=102022.12 | 45.1 | 127 | 1 | 1 | — | — | — | — | — | — | |
| DATMModel Arch.=VGG11-BN, IPC=502026.03 | 45 | — | — | — | 77 | 85 | 16.1 | — | 61 | 990.6 | |
| DATMModel Arch.=ConvNet, IPC=502026.03 | 44.6 | — | — | — | 76 | 84 | 12.2 | — | 60 | 992.5 | |
| SeqMatchModel Arch.=VGG11-BN, IPC=1002026.03 | 44.5 | — | — | — | 78 | 86 | 17.4 | — | 58 | 1,051.2 | |
| DATMModel Arch.=ResNet18, IPC=502026.03 | 44.3 | — | — | — | 75 | 83 | 14.1 | — | 59 | 1,021.1 | |
| Ours20Img/Cls=102022.12 | 44.1 | 6.4 | 19.9 | 1.07 | — | — | — | — | — | — | |
| DMipc=50, backbone=ConvNet-32022.11 | 43.6 | — | — | — | — | — | — | — | — | — | |
| DMImg/Cls=502022.12 | 43.6 | 2.78 | 61.4 | 0.55 | — | — | — | — | — | — | |
| FTDipc=10, backbone=ConvNet-32022.11 | 43.4 | — | — | — | — | — | — | — | — | — | |
| PPipc=10, backbone=ConvNet-32022.11 | 43.1 | — | — | — | — | — | — | — | — | — | |
| SeqMatchModel Arch.=ConvNet, IPC=1002026.03 | 43 | — | — | — | 77 | 86 | 17.1 | — | 58 | 1,024.5 | |
| CAFE+DSAipc=50, backbone=ConvNet-32022.11 | 42.9 | — | — | — | — | — | — | — | — | — | |
| DSAipc=50, backbone=ConvNet-32022.11 | 42.8 | — | — | — | — | — | — | — | — | — | |
| DSAImg/Cls=502022.12 | 42.8 | 221.1 | 78.9 | 0.63 | — | — | — | — | — | — | |
| FTDModel Arch.=ConvNet, IPC=1002026.03 | 42.8 | — | — | — | 77 | 85 | 16.2 | — | 61 | 1,067.3 | |
| DATMModel Arch.=AlexNet, IPC=502026.03 | 42.8 | — | — | — | 75 | 83 | 8.7 | — | 59 | 1,014.7 | |
| SeqMatchModel Arch.=AlexNet, IPC=1002026.03 | 42.1 | — | — | — | 77 | 85 | 16.1 | — | 57 | 1,032.5 | |
| MTTModel Arch.=ResNet18, IPC=1002026.03 | 41.9 | — | — | — | 81 | 88 | 24.8 | — | 56 | 1,089.2 | |
| FTDModel Arch.=VGG11-BN, IPC=1002026.03 | 41.6 | — | — | — | 76 | 85 | 15.2 | — | 61 | 1,028.9 | |
| MTTModel Arch.=VGG11-BN, IPC=1002026.03 | 40.7 | — | — | — | 79 | 87 | 20.9 | — | 58 | 1,035.2 | |
| MTTModel Arch.=ConvNet, IPC=1002026.03 | 40.5 | — | — | — | 79 | 86 | 18.9 | 84.1 | 59 | 1,023.4 | |
| FTDModel Arch.=ResNet18, IPC=1002026.03 | 40.5 | — | — | — | 77 | 84 | 14.5 | — | 60 | 1,043.5 | |
| SeqMatchModel Arch.=VGG11-BN, IPC=502026.03 | 40.4 | — | — | — | 77 | 85 | 13.6 | — | 56 | 1,033.3 | |
| TMImg/Cls=102022.12 | 40.1 | 9.47 | 14.7 | 0.92 | — | — | — | — | — | — | |
| SelMatchModel Arch.=AlexNet, IPC=252026.03 | 39.9 | — | — | — | 77 | 85 | 12.2 | — | 54 | 1,084.6 | |
| MTTipc=10, backbone=ConvNet-32022.11 | 39.7 | — | — | — | — | — | — | — | — | — | |
| MTT+Robust Learningipc=10, backbone=ConvNet-32022.11 | 39.4 | — | — | — | — | — | — | — | — | — | |
| SeqMatchModel Arch.=ConvNet, IPC=502026.03 | 39.2 | — | — | — | 77 | 85 | 16.1 | — | 57 | 1,037.6 | |
| MTTModel Arch.=AlexNet, IPC=1002026.03 | 38.7 | — | — | — | 77 | 85 | 16 | — | 58 | 1,037.5 | |
| SelMatchModel Arch.=ConvNet, IPC=252026.03 | 38.6 | — | — | — | 76 | 83 | 15.7 | — | 55 | 1,036.5 | |
| FTDModel Arch.=AlexNet, IPC=1002026.03 | 38.5 | — | — | — | 75 | 83 | 15.1 | — | 60 | 1,018.3 | |
| SelMatchModel Arch.=VGG11-BN, IPC=252026.03 | 38.4 | — | — | — | 79 | 86 | 17.3 | — | 55 | 1,042.6 | |
| SeqMatchModel Arch.=ResNet18, IPC=502026.03 | 38.1 | — | — | — | 74 | 81 | 12.7 | — | 56 | 1,044.8 | |
| CAFEipc=50, backbone=ConvNet-32022.11 | 37.9 | — | — | — | — | — | — | — | — | — | |
| CAFEImg/Cls=502022.12 | 37.9 | — | — | 0.56 | — | — | — | — | — | — | |
| FTDModel Arch.=ConvNet, IPC=502026.03 | 37.6 | — | — | — | 74 | 82 | 9.6 | — | 60 | 1,073.3 | |
| SelMatchModel Arch.=ResNet18, IPC=252026.03 | 37.5 | — | — | — | 78 | 86 | 17.4 | — | 57 | 1,028.5 | |
| SeqMatchModel Arch.=AlexNet, IPC=502026.03 | 37.2 | — | — | — | 75 | 83 | 12.9 | — | 55 | 1,078.3 | |
| FTDModel Arch.=ResNet18, IPC=502026.03 | 36.6 | — | — | — | 72 | 80 | 10.5 | — | 59 | 1,067.4 | |
| MTTModel Arch.=VGG11-BN, IPC=502026.03 | 36.2 | — | — | — | 76 | 80 | 14.1 | — | 55 | 1,075.2 | |
| FTDModel Arch.=VGG11-BN, IPC=502026.03 | 35.7 | — | — | — | 77 | 86 | 15.1 | — | 58 | 1,036.9 | |
| MTTModel Arch.=AlexNet, IPC=502026.03 | 35.6 | — | — | — | 77 | 85 | 10.4 | — | 56 | 1,043.9 | |
| SeqMatchModel Arch.=ResNet18, IPC=252026.03 | 35.2 | — | — | — | 74 | 81 | 7.5 | — | 55 | 1,053.1 | |
| DATMModel Arch.=ResNet18, IPC=252026.03 | 35.1 | — | — | — | 76 | 85 | 11.7 | — | 57 | 1,048.2 | |
| MTTModel Arch.=ConvNet, IPC=502026.03 | 34.8 | — | — | — | 73 | 81 | 9.5 | 82.7 | 55 | 1,082.5 | |
| SeqMatchModel Arch.=VGG11-BN, IPC=252026.03 | 33.9 | — | — | — | 74 | 82 | 7.2 | — | 53 | 1,088.4 | |
| DATMModel Arch.=AlexNet, IPC=252026.03 | 33.7 | — | — | — | 75 | 83 | 9.1 | — | 56 | 1,043.8 | |
| MTTModel Arch.=ResNet18, IPC=502026.03 | 33.5 | — | — | — | 73 | 80 | 7.4 | — | 56 | 1,052.1 | |
| DATMModel Arch.=VGG11-BN, IPC=252026.03 | 33.2 | — | — | — | 75 | 83 | 8.6 | — | 55 | 1,036.4 | |
| SeqMatchModel Arch.=ConvNet, IPC=252026.03 | 32.8 | — | — | — | 73 | 81 | 8.8 | — | 54 | 1,077.5 | |
| DATMModel Arch.=ConvNet, IPC=252026.03 | 32.6 | — | — | — | 74 | 82 | 10.2 | — | 57 | 1,056.8 | |
| DSAipc=10, backbone=ConvNet-32022.11 | 32.3 | — | — | — | — | — | — | — | — | — | |
| DSAImg/Cls=102022.12 | 32.3 | 17.5 | 78.9 | 0.63 | — | — | — | — | — | — | |
| SelMatchModel Arch.=ConvNet, IPC=102026.03 | 32.2 | — | — | — | 74 | 82 | 9.7 | — | 54 | 1,067.4 | |
| FTDModel Arch.=AlexNet, IPC=502026.03 | 31.8 | — | — | — | 73 | 81 | 6.3 | — | 59 | 1,056.9 | |
| SeqMatchModel Arch.=AlexNet, IPC=252026.03 | 31.6 | — | — | — | 72 | 80 | 8.9 | — | 54 | 1,086.3 | |
| CAFE+DSAipc=10, backbone=ConvNet-32022.11 | 31.5 | — | — | — | — | — | — | — | — | — | |
| SelMatchModel Arch.=AlexNet, IPC=102026.03 | 31.3 | — | — | — | 73 | 80 | 8.9 | — | 54 | 1,064.9 | |
| SelMatchModel Arch.=ResNet18, IPC=102026.03 | 30.6 | — | — | — | 72 | 79 | 4.3 | — | 53 | 1,078.4 | |
| SelMatchModel Arch.=VGG11-BN, IPC=102026.03 | 30.5 | — | — | — | 74 | 82 | 7.1 | — | 54 | 1,089.4 | |
| MTTModel Arch.=ResNet18, IPC=252026.03 | 30.1 | — | — | — | 65 | 71 | 1.3 | — | 54 | 1,034 | |
| Ours5Img/Cls=12022.12 | 29.8 | 25.1 | 4.97 | 1.1 | — | — | — | — | — | — | |
| DMipc=10, backbone=ConvNet-32022.11 | 29.7 | — | — | — | — | — | — | — | — | — | |
| DMImg/Cls=102022.12 | 29.7 | 2.64 | 61.4 | 0.55 | — | — | — | — | — | — | |
| Ours10Img/Cls=12022.12 | 29.4 | 12.5 | 9.96 | 1.09 | — | — | — | — | — | — | |
| MTTModel Arch.=VGG11-BN, IPC=252026.03 | 29.2 | — | — | — | 66 | 72 | 1.9 | — | 54 | 1,058.6 | |
| Ours20Img/Cls=12022.12 | 29.1 | 6.27 | 19.9 | 1.07 | — | — | — | — | — | — | |
| SeqMatchModel Arch.=VGG11-BN, IPC=102026.03 | 29.1 | — | — | — | 71 | 77 | 3.7 | — | 52 | 1,102.3 | |
| SeqMatchModel Arch.=ResNet18, IPC=102026.03 | 28.5 | — | — | — | 69 | 76 | 2.6 | — | 52 | 1,092.3 | |
| DATMModel Arch.=ResNet18, IPC=102026.03 | 28.3 | — | — | — | 70 | 77 | 4.2 | — | 54 | 1,077.5 | |
| MTTModel Arch.=ConvNet, IPC=252026.03 | 28.2 | — | — | — | 65 | 71 | 1.8 | 83.2 | 56 | 1,032.7 | |
| DATMModel Arch.=VGG11-BN, IPC=102026.03 | 28.1 | — | — | — | 69 | 76 | 1.4 | — | 53 | 1,089 | |
| CAFEipc=10, backbone=ConvNet-32022.11 | 27.8 | — | — | — | — | — | — | — | — | — | |
| CAFEImg/Cls=102022.12 | 27.8 | — | — | 0.56 | — | — | — | — | — | — |