Privacy Classification on PrivBench
0.9MCCInternVL2.5-4B (Privacy VLM)
Evaluation Results
| Method | Links | |
|---|---|---|
| InternVL2.5-4B (Privacy VLM)LLM=Phi-3-mini-128k, Vision Encoder=InternViT-300M, Variant=Privacy VLM2024.05 | 0.9 | |
| TinyLLaVA (Privacy VLM)LLM=Phi-2-2.7B, Vision Encoder=SigLIP, Variant=Privacy VLM2024.05 | 0.86 | |
| CoAgentLLM=Vicuna-7B, Vision Encoder=EVA2-CLIP-L2024.05 | 0.72 | |
| MoELLaVALLM=Phi-2-2.7B, Vision Encoder=CLIP ViT-L/142024.05 | 0.72 | |
| LLaVALLM=Vicuna-7B, Vision Encoder=CLIP ViT-L/142024.05 | 0.69 | |
| InternVL2.5-4BLLM=Phi-3-mini-128k, Vision Encoder=InternViT-300M2024.05 | 0.69 | |
| ShareGPTLLM=Vicuna-7B, Vision Encoder=CLIP2024.05 | 0.67 | |
| InternVL2.5-2B (Privacy VLM)LLM=InternLM2-1.8B, Vision Encoder=InternViT-300M, Variant=Privacy VLM2024.05 | 0.65 | |
| CogVLMLLM=Vicuna-7B, Vision Encoder=EVA2-CLIP-E2024.05 | 0.64 | |
| TinyLLaVALLM=Phi-2-2.7B, Vision Encoder=SigLIP2024.05 | 0.6 | |
| GPT-4LLM=–, Vision Encoder=–2024.05 | 0.5 | |
| InternVL2.5-2BLLM=InternLM2-1.8B, Vision Encoder=InternViT-300M2024.05 | 0.39 | |
| OtterLLM=MPT-7B, Vision Encoder=CLIP ViT-L/142024.05 | 0.29 | |
| InstructBLIPLLM=Vicuna-7B, Vision Encoder=Q-Former2024.05 | 0.19 | |
| FuyuLLM=Persimmon-8B, Vision Encoder=–2024.05 | 0.09 |