Privacy Classification on PrivBench-H
0.53MCCTinyLLaVA (Privacy VLM)
Evaluation Results
| Method | Links | |
|---|---|---|
| TinyLLaVA (Privacy VLM)LLM=Phi-2-2.7B, Vision Encoder=SigLIP, Variant=Privacy VLM2024.05 | 0.53 | |
| InternVL2.5-4B (Privacy VLM)LLM=Phi-3-mini-128k, Vision Encoder=InternViT-300M, Variant=Privacy VLM2024.05 | 0.51 | |
| GPT-4LLM=–, Vision Encoder=–2024.05 | 0.48 | |
| ShareGPTLLM=Vicuna-7B, Vision Encoder=CLIP2024.05 | 0.47 | |
| InternVL2.5-4BLLM=Phi-3-mini-128k, Vision Encoder=InternViT-300M2024.05 | 0.46 | |
| TinyLLaVALLM=Phi-2-2.7B, Vision Encoder=SigLIP2024.05 | 0.43 | |
| LLaVALLM=Vicuna-7B, Vision Encoder=CLIP ViT-L/142024.05 | 0.42 | |
| MoELLaVALLM=Phi-2-2.7B, Vision Encoder=CLIP ViT-L/142024.05 | 0.4 | |
| InternVL2.5-2B (Privacy VLM)LLM=InternLM2-1.8B, Vision Encoder=InternViT-300M, Variant=Privacy VLM2024.05 | 0.36 | |
| CogVLMLLM=Vicuna-7B, Vision Encoder=EVA2-CLIP-E2024.05 | 0.33 | |
| CoAgentLLM=Vicuna-7B, Vision Encoder=EVA2-CLIP-L2024.05 | 0.33 | |
| InternVL2.5-2BLLM=InternLM2-1.8B, Vision Encoder=InternViT-300M2024.05 | 0.22 | |
| OtterLLM=MPT-7B, Vision Encoder=CLIP ViT-L/142024.05 | 0.1 | |
| InstructBLIPLLM=Vicuna-7B, Vision Encoder=Q-Former2024.05 | 0.08 | |
| FuyuLLM=Persimmon-8B, Vision Encoder=–2024.05 | -0.03 |