List your company

Safeguarding on VLGuard & MSSBench (test)

88.71Average ScoreVLMGuard
61.992468.928775.86582.8013Oct 1, 2024

Evaluation results

MethodLinks
VLMGuardModel=Qwen2.5-VL-7B-Instruct, Attack Type=Attacker-aware paraphrase attacks, M (lowest-score variants)=52024.1088.71
HiddenDetectModel=Qwen2.5-VL-7B-Instruct, Attack Type=Attacker-aware paraphrase attacks, M (lowest-score variants)=52024.1064.13
ASTRAModel=Qwen2.5-VL-7B-Instruct, Attack Type=Attacker-aware paraphrase attacks, M (lowest-score variants)=52024.1063.02