Visual Question Answering on VQA v2 (Probing Refusal Metrics)
0Refusal Rate (Exact)No Perturbation
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| No PerturbationTarget MLLM=LLaVA-1.52026.04 | 0 | 0 | 0 | |
| Qi et al.Target MLLM=LLaVA-1.52026.04 | 2 | 2 | 2 | |
| Bagdasaryan et al.Target MLLM=LLaVA-1.52026.04 | 65 | 62 | 51 | |
| ImageProtector+PGDTarget MLLM=LLaVA-1.52026.04 | 94 | 91 | 91 | |
| ImageProtectorTarget MLLM=LLaVA-1.52026.04 | 94 | 88 | 88 |