List your company
ResearchFormerly WizWand

Privacy Classification on PrivBench

0.9MCCInternVL2.5-4B (Privacy VLM)
0.05760.27630.4950.7137May 27, 2024
Updated 4mo ago

Evaluation results

MethodLinks
InternVL2.5-4B (Privacy VLM)LLM=Phi-3-mini-128k, Vision Encoder=InternViT-300M, Variant=Privacy VLM2024.050.9
TinyLLaVA (Privacy VLM)LLM=Phi-2-2.7B, Vision Encoder=SigLIP, Variant=Privacy VLM2024.050.86
CoAgentLLM=Vicuna-7B, Vision Encoder=EVA2-CLIP-L2024.050.72
MoELLaVALLM=Phi-2-2.7B, Vision Encoder=CLIP ViT-L/142024.050.72
LLaVALLM=Vicuna-7B, Vision Encoder=CLIP ViT-L/142024.050.69
InternVL2.5-4BLLM=Phi-3-mini-128k, Vision Encoder=InternViT-300M2024.050.69
ShareGPTLLM=Vicuna-7B, Vision Encoder=CLIP2024.050.67
InternVL2.5-2B (Privacy VLM)LLM=InternLM2-1.8B, Vision Encoder=InternViT-300M, Variant=Privacy VLM2024.050.65
CogVLMLLM=Vicuna-7B, Vision Encoder=EVA2-CLIP-E2024.050.64
TinyLLaVALLM=Phi-2-2.7B, Vision Encoder=SigLIP2024.050.6
GPT-4LLM=–, Vision Encoder=–2024.050.5
InternVL2.5-2BLLM=InternLM2-1.8B, Vision Encoder=InternViT-300M2024.050.39
OtterLLM=MPT-7B, Vision Encoder=CLIP ViT-L/142024.050.29
InstructBLIPLLM=Vicuna-7B, Vision Encoder=Q-Former2024.050.19
FuyuLLM=Persimmon-8B, Vision Encoder=–2024.050.09