List your company
ResearchFormerly WizWand

Refusal Rate Evaluation on CelebA

81Refusal RateImageProtector
80.2485.3790.595.63Apr 10, 2026
Updated 7mo ago

Evaluation results

MethodLinks
ImageProtectorTarget MLLM=Phi-4-multimodal, Shadow Question Type=general probing questions, Question Relevance=image-irrelevant2026.0481
ImageProtectorTarget MLLM=Phi-4-multimodal, Shadow Question Type=similar, Question Relevance=image-irrelevant2026.0485
ImageProtectorTarget MLLM=Qwen-VL-Chat, Shadow Question Type=general probing questions, Question Relevance=image-irrelevant2026.0486
ImageProtectorTarget MLLM=Phi-4-multimodal, Shadow Question Type=Similar probing questions, Question Relevance=Image-relevant2026.0487
ImageProtectorTarget MLLM=InstructBLIP, Shadow Question Type=general probing questions, Question Relevance=image-irrelevant2026.0487
ImageProtectorTarget MLLM=Qwen2.5-VL, Shadow Question Type=general probing questions, Question Relevance=image-irrelevant2026.0487
ImageProtectorTarget MLLM=InstructBLIP, Shadow Question Type=similar, Question Relevance=image-irrelevant2026.0487
ImageProtectorTarget MLLM=InstructBLIP, Shadow Question Type=Similar probing questions, Question Relevance=Image-relevant2026.0489
ImageProtectorTarget MLLM=InstructBLIP, Probing Question Type=exact, Question Relevance=image-irrelevant2026.0490
ImageProtectorTarget MLLM=InstructBLIP, Shadow Question Type=exact, Question Relevance=image-relevant2026.0493
ImageProtectorTarget MLLM=Qwen-VL-Chat, Probing Question Type=exact, Question Relevance=image-irrelevant2026.0494
ImageProtectorTarget MLLM=LLaVA-1.5, Shadow Question Type=similar, Question Relevance=image-irrelevant2026.0494
ImageProtectorTarget MLLM=Qwen2.5-VL, Shadow Question Type=similar, Question Relevance=image-irrelevant2026.0494
ImageProtectorTarget MLLM=Qwen2.5-VL, Shadow Question Type=Similar probing questions, Question Relevance=Image-relevant2026.0495
ImageProtectorTarget MLLM=MiniGPT-4, Shadow Question Type=general probing questions, Question Relevance=image-irrelevant2026.0495
ImageProtectorTarget MLLM=MiniGPT-4, Probing Question Type=exact, Question Relevance=image-irrelevant2026.0496
ImageProtectorTarget MLLM=Qwen-VL-Chat, Shadow Question Type=similar, Question Relevance=image-irrelevant2026.0496
ImageProtectorTarget MLLM=LLaVA-1.5, Shadow Question Type=general probing questions, Question Relevance=image-irrelevant2026.0497
ImageProtectorTarget MLLM=MiniGPT-4, Shadow Question Type=exact, Question Relevance=image-relevant2026.0497
ImageProtectorTarget MLLM=MiniGPT-4, Shadow Question Type=Similar probing questions, Question Relevance=Image-relevant2026.0498
ImageProtectorTarget MLLM=Qwen-VL-Chat, Shadow Question Type=Similar probing questions, Question Relevance=Image-relevant2026.0498
ImageProtectorTarget MLLM=LLaVA-1.5, Probing Question Type=exact, Question Relevance=image-irrelevant2026.0498
ImageProtectorTarget MLLM=Qwen-VL-Chat, Shadow Question Type=exact, Question Relevance=image-relevant2026.0499
ImageProtectorTarget MLLM=MiniGPT-4, Shadow Question Type=similar, Question Relevance=image-irrelevant2026.0499
ImageProtectorTarget MLLM=LLaVA-1.5, Shadow Question Type=Similar probing questions, Question Relevance=Image-relevant2026.04100
ImageProtectorTarget MLLM=Phi-4-multimodal, Probing Question Type=exact, Question Relevance=image-irrelevant2026.04100
ImageProtectorTarget MLLM=Qwen2.5-VL, Probing Question Type=exact, Question Relevance=image-irrelevant2026.04100
ImageProtectorTarget MLLM=LLaVA-1.5, Shadow Question Type=exact, Question Relevance=image-relevant2026.04100
ImageProtectorTarget MLLM=Phi-4-multimodal, Shadow Question Type=exact, Question Relevance=image-relevant2026.04100
ImageProtectorTarget MLLM=Qwen2.5-VL, Shadow Question Type=exact, Question Relevance=image-relevant2026.04100