List your company
ResearchFormerly WizWand

Safety Evaluation on JailbreakLLMs Noise

0.38Unsafe RateVLGuard Mixed
-0.63526.217413.0719.9226Oct 11, 2024
Updated 8mo ago

Evaluation results

MethodLinks
VLGuard MixedBackbone=LLaVA-v1.5-7B2024.100.38
VLGuard MixedBackbone=LLaVA-v1.5-13B2024.100.38
VLGuard PHBackbone=LLaVA-v1.5-13B2024.100.38
CMRM_sampleBackbone=LLaVA-v1.5-13B2024.102.27
VLGuard PHBackbone=LLaVA-v1.5-7B2024.102.65
CMRM_sampleBackbone=LLaVA-v1.5-7B2024.104.92
CMRM_sampleBackbone=ShareGPT4V2024.106.06
CMRM_datasetBackbone=LLaVA-v1.5-7B2024.107.2
CMRM_datasetBackbone=ShareGPT4V2024.108.33
CMRM_datasetBackbone=LLaVA-v1.5-13B2024.108.71
LLaVA-v1.5-13BInput Protocol=Noisy Image2024.1014.77
ShareGPT4VInput Protocol=Noisy Image2024.1024.24
LLaVA-v1.5-7BInput Protocol=Noisy Image2024.1025.76