List your company
ResearchFormerly WizWand

Safety Evaluation on VLSafe Orig.

0.23Unsafe RateVLGuard PH
-2.22214.32930.8847.431Oct 11, 2024
Updated 8mo ago

Evaluation results

MethodLinks
VLGuard PHBackbone=LLaVA-v1.5-7B2024.100.23
VLGuard PHBackbone=LLaVA-v1.5-13B2024.100.56
LLaVA-v1.5-13BInput Protocol=Query2024.100.68
CMRM_sampleBackbone=LLaVA-v1.5-13B2024.100.79
VLGuard MixedBackbone=LLaVA-v1.5-13B2024.101.13
LLaVA-v1.5-13BInput Protocol=Caption2024.101.25
CMRM_sampleBackbone=ShareGPT4V2024.101.46
LLaVA-v1.5-7BInput Protocol=Query2024.101.91
CMRM_datasetBackbone=ShareGPT4V2024.101.91
VLGuard MixedBackbone=LLaVA-v1.5-7B2024.102.03
CMRM_sampleBackbone=LLaVA-v1.5-7B2024.103.15
ShareGPT4VInput Protocol=Query2024.104.13
CMRM_datasetBackbone=LLaVA-v1.5-13B2024.104.95
ShareGPT4VInput Protocol=Caption2024.105.32
CMRM_datasetBackbone=LLaVA-v1.5-7B2024.105.41
LLaVA-v1.5-7BInput Protocol=Caption2024.105.52
LLaVA-v1.5-13BInput Protocol=Visual (Orig.)2024.1031.8
ShareGPT4VInput Protocol=Visual (Orig.)2024.1057.09
LLaVA-v1.5-7BInput Protocol=Visual (Orig.)2024.1061.53