Privacy Classification on VISPR
0.39MCCInternVL2.5-4B (Privacy VLM)
Evaluation Results
| Method | Links | |
|---|---|---|
| InternVL2.5-4B (Privacy VLM)LLM=Phi-3-mini-128k, Vision Encoder=InternViT-300M, Variant=Privacy VLM2024.05 | 0.39 | |
| TinyLLaVA (Privacy VLM)LLM=Phi-2-2.7B, Vision Encoder=SigLIP, Variant=Privacy VLM2024.05 | 0.35 | |
| InternVL2.5-2B (Privacy VLM)LLM=InternLM2-1.8B, Vision Encoder=InternViT-300M, Variant=Privacy VLM2024.05 | 0.25 | |
| InternVL2.5-4BLLM=Phi-3-mini-128k, Vision Encoder=InternViT-300M2024.05 | 0.24 | |
| ShareGPTLLM=Vicuna-7B, Vision Encoder=CLIP2024.05 | 0.23 | |
| LLaVALLM=Vicuna-7B, Vision Encoder=CLIP ViT-L/142024.05 | 0.22 | |
| CoAgentLLM=Vicuna-7B, Vision Encoder=EVA2-CLIP-L2024.05 | 0.19 | |
| TinyLLaVALLM=Phi-2-2.7B, Vision Encoder=SigLIP2024.05 | 0.19 | |
| CogVLMLLM=Vicuna-7B, Vision Encoder=EVA2-CLIP-E2024.05 | 0.18 | |
| InstructBLIPLLM=Vicuna-7B, Vision Encoder=Q-Former2024.05 | 0.16 | |
| GPT-4LLM=–, Vision Encoder=–2024.05 | 0.16 | |
| MoELLaVALLM=Phi-2-2.7B, Vision Encoder=CLIP ViT-L/142024.05 | 0.16 | |
| OtterLLM=MPT-7B, Vision Encoder=CLIP ViT-L/142024.05 | 0.14 | |
| InternVL2.5-2BLLM=InternLM2-1.8B, Vision Encoder=InternViT-300M2024.05 | 0.1 | |
| FuyuLLM=Persimmon-8B, Vision Encoder=–2024.05 | 0 |