Image Classification on SVHN 1.0 (test) (Adversarial Robustness) benchmark leaderboard · SOTA2 Research

Image Classification on SVHN 1.0 (test) (Adversarial Robustness)

94.2Natural AccuracyMART

Evaluation Results

Method	Links
MART2023.03		94.2	75	58	53.1	52.8	52.8	48.9
AWP + CAFE2023.03		94.2	76.9	62.7	57.5	59.2	57.1	54.6
ADV2023.03		94	71.8	56.7	53.2	51.9	52.8	49
HELP + CAFE2023.03		94	76.6	62.6	57.7	58.8	57.2	55
TRADES2023.03		93.8	74	58.1	53.9	53	53.4	49.9
MART2023.03		93.7	74.2	58.3	51.7	53.2	50.8	47.8
ADV + CAFE2023.03		93.7	75.7	59.1	54.9	54	54.1	50.2
HELP2023.03		93.5	73.4	60.8	56.5	57.6	56.1	54
AWP + CAFE2023.03		93.4	74	60.9	55	57.8	54.8	52.7
TRADES2023.03		93.2	72.8	57.7	52.6	53	51.5	48.9
AWP2023.03		93.2	73.4	60.8	55.9	57.5	55.5	53.6
MART + CAFE2023.03		93	76.5	61.9	54.9	57.2	53.8	50.7
HELP + CAFE2023.03		92.9	73.9	61.3	55.3	58.8	54.6	52.8
ADV2023.03		92.8	70.4	55.4	51.3	50.9	51	47.5
MART2023.03		92.6	66.6	54.2	47.9	49.6	47.1	44.4
HELP2023.03		92.6	72	59.8	54.4	56.6	53.9	52
ADV + CAFE2023.03		92.5	73.6	58.9	53.8	54.9	52.6	49.8
TRADES + CAFE2023.03		92.4	75.6	61	55.7	58	58	53
MART + CAFE2023.03		92.2	74.9	61	53.4	57.3	51.8	49.7
AWP2023.03		92.2	71.1	59.8	54.3	56.8	53.6	52
ADV2023.03		91.9	64.8	52.1	48.9	48	48.5	45.2
TRADES2023.03		91.9	66.4	53.6	49.1	49.1	47.7	45.2
AWP + CAFE2023.03		91.9	67.9	58.6	51.2	55.9	51.1	49.7
ADV + CAFE2023.03		91.5	67	55.3	50	51.3	49.6	46.1
HELP + CAFE2023.03		91.5	67.3	58.5	51.6	56.2	51.4	50
MART + CAFE2023.03		91.3	67.6	57.3	49.5	54.2	48.3	46.4
TRADES + CAFE2023.03		91.3	—	59.6	54.1	56.7	53.2	51.3
HELP2023.03		91.2	65.8	56.6	50.9	53.9	50.2	48.8
AWP2023.03		90.8	65.5	56.6	50.4	54	49.7	48.6
TRADES + CAFE2023.03		90.3	67.8	56.1	50	53.6	49.1	47.5