List your company
ResearchFormerly WizWand

Distribution Shift Detection on CIFAR-10 vs CIFAR-10.1

1Average Rejection RateMMD + SimCLRv2
0.059840.303920.5480.79208Oct 4, 2022
Updated 8mo ago

Evaluation results

MethodLinks
MMD + SimCLRv2Sample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.101
MMD + SimCLRv2Sample size (n)=1000, Backbone=ResNet-50, Significance level (alpha)=0.052022.101
MMD-CC + SimCLRv2Sample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.101
MMD-CC + SimCLRv2Sample size (n)=1000, Backbone=ResNet-50, Significance level (alpha)=0.052022.101
MMD + SupervisedSample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.101
MMD + SupervisedSample size (n)=1000, Backbone=ResNet-50, Significance level (alpha)=0.052022.101
MMD-CC + SupervisedSample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.101
MMD-CC + SupervisedSample size (n)=1000, Backbone=ResNet-50, Significance level (alpha)=0.052022.101
MMD + SimCLRv2Sample size (n)=500, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.997
MMD-CC + SimCLRv2Sample size (n)=500, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.997
MMD + SupervisedSample size (n)=500, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.884
MMD-CC + SupervisedSample size (n)=500, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.87
MMD-DSample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.744
MMD + SimCLRv2Sample size (n)=200, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.702
MMD-CC + SimCLRv2Sample size (n)=200, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.686
MESample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.588
C2ST-LSample size (n)=2000, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.529
MMD + SimCLRv2Sample size (n)=100, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.325
MMD + SupervisedSample size (n)=200, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.305
MMD-CC + SimCLRv2Sample size (n)=100, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.304
MMD-CC + SupervisedSample size (n)=200, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.298
MMD + SimCLRv2Sample size (n)=50, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.154
MMD-CC + SimCLRv2Sample size (n)=50, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.15
MMD + SupervisedSample size (n)=100, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.135
MMD-CC + SupervisedSample size (n)=100, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.131
MMD + SupervisedSample size (n)=50, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.103
MMD-CC + SupervisedSample size (n)=50, Backbone=ResNet-50, Significance level (alpha)=0.052022.100.096