List your company
ResearchFormerly WizWand

Privacy Classification on PrivBench-H

0.53MCCTinyLLaVA (Privacy VLM)
-0.05240.09880.250.4012May 27, 2024
Updated 4mo ago

Evaluation results

MethodLinks
TinyLLaVA (Privacy VLM)LLM=Phi-2-2.7B, Vision Encoder=SigLIP, Variant=Privacy VLM2024.050.53
InternVL2.5-4B (Privacy VLM)LLM=Phi-3-mini-128k, Vision Encoder=InternViT-300M, Variant=Privacy VLM2024.050.51
GPT-4LLM=–, Vision Encoder=–2024.050.48
ShareGPTLLM=Vicuna-7B, Vision Encoder=CLIP2024.050.47
InternVL2.5-4BLLM=Phi-3-mini-128k, Vision Encoder=InternViT-300M2024.050.46
TinyLLaVALLM=Phi-2-2.7B, Vision Encoder=SigLIP2024.050.43
LLaVALLM=Vicuna-7B, Vision Encoder=CLIP ViT-L/142024.050.42
MoELLaVALLM=Phi-2-2.7B, Vision Encoder=CLIP ViT-L/142024.050.4
InternVL2.5-2B (Privacy VLM)LLM=InternLM2-1.8B, Vision Encoder=InternViT-300M, Variant=Privacy VLM2024.050.36
CogVLMLLM=Vicuna-7B, Vision Encoder=EVA2-CLIP-E2024.050.33
CoAgentLLM=Vicuna-7B, Vision Encoder=EVA2-CLIP-L2024.050.33
InternVL2.5-2BLLM=InternLM2-1.8B, Vision Encoder=InternViT-300M2024.050.22
OtterLLM=MPT-7B, Vision Encoder=CLIP ViT-L/142024.050.1
InstructBLIPLLM=Vicuna-7B, Vision Encoder=Q-Former2024.050.08
FuyuLLM=Persimmon-8B, Vision Encoder=–2024.05-0.03