Anomaly Detection on MVTec Anomaly Detection 1.0 (test)

0.947PRO (Carpet)SPADE

Evaluation results

Method
SPADE2020.05	0.947	0.917	0.867	0.972	0.759	0.874	0.955	0.909	0.937	0.954	0.944	0.946	0.96	0.935	0.874	0.926
MOCCA2020.12	0.86	—	0.87	0.98	0.89	1	0.95	0.76	0.82	0.8	0.85	0.82	0.84	0.97	0.88	0.84
CAVGA-Du2020.12	0.78	—	0.78	0.75	0.72	0.88	0.91	0.67	0.87	0.87	0.71	0.91	0.78	0.97	0.75	0.94
MOCCA2020.12	0.74	—	0.81	0.95	0.85	0.97	0.93	0.72	0.79	0.78	0.84	0.73	0.8	0.95	0.84	0.82
CAVGA-Ru2020.12	0.73	—	0.75	0.71	0.7	0.85	0.89	0.63	0.83	0.84	0.67	0.88	0.77	0.91	0.73	0.87
ITAE2020.12	0.71	—	0.88	0.86	0.74	0.92	0.94	0.83	0.68	0.86	0.67	0.79	1	1	0.84	0.88
GANomaly2020.12	0.7	—	0.71	0.84	0.79	0.83	0.89	0.76	0.73	0.79	0.7	0.74	0.75	0.65	0.79	0.75
Uninformed Students2019.11	0.695	0.857	0.819	0.819	0.912	0.725	0.918	0.865	0.916	0.937	0.895	0.935	0.928	0.863	0.701	0.933
Student2020.05	0.695	0.857	0.819	0.819	0.912	0.725	0.918	0.865	0.916	0.937	0.895	0.935	0.928	0.863	0.701	0.933
SSIM-AE2019.11	0.647	0.694	0.849	0.561	0.175	0.605	0.834	0.478	0.86	0.916	0.603	0.83	0.887	0.784	0.725	0.665
SSIM-AE2020.05	0.647	0.694	0.849	0.561	0.175	0.605	0.834	0.478	0.86	0.916	0.603	0.83	0.887	0.784	0.725	0.665
AEL22020.12	0.64	—	0.83	0.8	0.74	0.97	0.65	0.64	0.62	0.73	0.64	0.77	1	0.77	0.65	0.87
CBIGAN2020.12	0.55	—	0.99	0.83	0.91	0.95	0.87	0.81	0.56	0.77	0.63	0.81	0.58	0.94	0.77	0.53
EGBAD2020.12	0.52	—	0.54	0.55	0.79	0.91	0.63	0.68	0.52	0.43	0.47	0.57	0.46	0.64	0.73	0.58
1-NN2019.11	0.512	0.64	0.228	0.446	0.822	0.502	0.898	0.806	0.631	0.861	0.705	0.725	0.604	0.675	0.68	0.512
1-NN2020.05	0.512	0.64	0.228	0.446	0.822	0.502	0.898	0.806	0.631	0.861	0.705	0.725	0.604	0.675	0.68	0.512
VAE2019.11	0.501	0.639	0.224	0.635	0.87	0.628	0.897	0.654	0.526	0.878	0.576	0.769	0.559	0.693	0.626	0.549
VAE2020.05	0.501	0.639	0.224	0.635	0.87	0.628	0.897	0.654	0.526	0.878	0.576	0.769	0.559	0.693	0.626	0.549
CNN Feature Dictionary2019.11	0.469	0.515	0.183	0.641	0.797	0.621	0.742	0.558	0.306	0.844	0.358	0.46	0.277	0.151	0.628	0.703
CNN-Dict2020.05	0.469	0.515	0.183	0.641	0.797	0.621	0.742	0.558	0.306	0.844	0.358	0.46	0.277	0.151	0.628	0.703
l2-AE2019.11	0.456	0.79	0.582	0.819	0.897	0.727	0.91	0.825	0.862	0.917	0.83	0.893	0.754	0.822	0.728	0.839
l2-AE2020.05	0.456	0.79	0.582	0.819	0.897	0.727	0.91	0.825	0.862	0.917	0.83	0.893	0.754	0.822	0.728	0.839
GeoTrans2020.12	0.44	—	0.62	0.84	0.42	0.61	0.74	0.78	0.67	0.36	0.81	0.63	0.5	0.97	0.87	0.82
OC-SVM2019.11	0.355	0.479	0.125	0.306	0.722	0.336	0.85	0.431	0.554	0.616	0.319	0.544	0.644	0.538	0.496	0.355
OC-SVM2020.05	0.355	0.479	0.125	0.306	0.722	0.336	0.85	0.431	0.554	0.616	0.319	0.544	0.644	0.538	0.496	0.355
K-Means2019.11	0.253	0.423	0.107	0.308	0.779	0.411	0.495	0.513	0.387	0.698	0.351	0.514	0.55	0.337	0.399	0.253
AnoGAN2019.11	0.204	0.443	0.226	0.378	0.177	0.386	0.62	0.383	0.306	0.698	0.32	0.776	0.466	0.749	0.549	0.467