Distribution Shift Detection on CIFAR-10 vs CIFAR-10.1
1Average Rejection RateMMD + SimCLRv2
Evaluation Results
| Method | Links | |
|---|---|---|
| MMD + SimCLRv2Sample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 1 | |
| MMD + SimCLRv2Sample size (n)=1000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 1 | |
| MMD-CC + SimCLRv2Sample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 1 | |
| MMD-CC + SimCLRv2Sample size (n)=1000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 1 | |
| MMD + SupervisedSample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 1 | |
| MMD + SupervisedSample size (n)=1000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 1 | |
| MMD-CC + SupervisedSample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 1 | |
| MMD-CC + SupervisedSample size (n)=1000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 1 | |
| MMD + SimCLRv2Sample size (n)=500, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.997 | |
| MMD-CC + SimCLRv2Sample size (n)=500, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.997 | |
| MMD + SupervisedSample size (n)=500, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.884 | |
| MMD-CC + SupervisedSample size (n)=500, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.87 | |
| MMD-DSample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.744 | |
| MMD + SimCLRv2Sample size (n)=200, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.702 | |
| MMD-CC + SimCLRv2Sample size (n)=200, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.686 | |
| MESample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.588 | |
| C2ST-LSample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.529 | |
| MMD + SimCLRv2Sample size (n)=100, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.325 | |
| MMD + SupervisedSample size (n)=200, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.305 | |
| MMD-CC + SimCLRv2Sample size (n)=100, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.304 | |
| MMD-CC + SupervisedSample size (n)=200, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.298 | |
| MMD + SimCLRv2Sample size (n)=50, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.154 | |
| MMD-CC + SimCLRv2Sample size (n)=50, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.15 | |
| MMD + SupervisedSample size (n)=100, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.135 | |
| MMD-CC + SupervisedSample size (n)=100, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.131 | |
| MMD + SupervisedSample size (n)=50, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.103 | |
| MMD-CC + SupervisedSample size (n)=50, Backbone=ResNet-50, Significance level (alpha)=0.052022.10 | 0.096 |