Safety Evaluation on VLSafe Noise
0Unsafe RateVLGuard PH
Evaluation results
| Method | Links | |
|---|---|---|
| VLGuard PHBackbone=LLaVA-v1.5-7B2024.10 | 0 | |
| VLGuard MixedBackbone=LLaVA-v1.5-13B2024.10 | 0 | |
| VLGuard MixedBackbone=LLaVA-v1.5-7B2024.10 | 0.1 | |
| CMRM_sampleBackbone=LLaVA-v1.5-13B2024.10 | 0.9 | |
| VLGuard PHBackbone=LLaVA-v1.5-13B2024.10 | 1.01 | |
| CMRM_sampleBackbone=LLaVA-v1.5-7B2024.10 | 1.46 | |
| CMRM_datasetBackbone=ShareGPT4V2024.10 | 1.91 | |
| CMRM_datasetBackbone=LLaVA-v1.5-7B2024.10 | 3.15 | |
| CMRM_datasetBackbone=LLaVA-v1.5-13B2024.10 | 4.73 | |
| CMRM_sampleBackbone=ShareGPT4V2024.10 | 6.98 | |
| LLaVA-v1.5-13BInput Protocol=Noisy Image2024.10 | 32.88 | |
| ShareGPT4VInput Protocol=Noisy Image2024.10 | 55.29 | |
| LLaVA-v1.5-7BInput Protocol=Noisy Image2024.10 | 57.21 |