List your company
ResearchFormerly WizWand

Safety Evaluation on JailbreakLLMs Orig.

0Unsafe RateVLGuard PH
-0.86084.949610.7616.5704Oct 11, 2024
Updated 8mo ago

Evaluation results

MethodLinks
VLGuard PHBackbone=LLaVA-v1.5-13B2024.100
VLGuard MixedBackbone=LLaVA-v1.5-13B2024.100.38
VLGuard MixedBackbone=LLaVA-v1.5-7B2024.100.76
CMRM_sampleBackbone=ShareGPT4V2024.101.14
LLaVA-v1.5-13BInput Protocol=Caption2024.101.82
VLGuard PHBackbone=LLaVA-v1.5-7B2024.102.27
LLaVA-v1.5-13BInput Protocol=Query2024.103.03
CMRM_sampleBackbone=LLaVA-v1.5-13B2024.103.03
CMRM_datasetBackbone=ShareGPT4V2024.103.79
CMRM_sampleBackbone=LLaVA-v1.5-7B2024.104.55
LLaVA-v1.5-7BInput Protocol=Caption2024.104.85
CMRM_datasetBackbone=LLaVA-v1.5-13B2024.104.92
CMRM_datasetBackbone=LLaVA-v1.5-7B2024.108.33
ShareGPT4VInput Protocol=Caption2024.108.33
ShareGPT4VInput Protocol=Query2024.1010.23
LLaVA-v1.5-13BInput Protocol=Visual (Orig.)2024.1012.42
LLaVA-v1.5-7BInput Protocol=Query2024.1012.73
ShareGPT4VInput Protocol=Visual (Orig.)2024.1019.32
LLaVA-v1.5-7BInput Protocol=Visual (Orig.)2024.1021.52