Privacy Classification on PrivAlert
0.51MCCLLaVA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LLaVAModel Category=Standard2024.05 | 0.51 | 71 | 58 | 47 | 76 | 95 | |
| TinyLLaVaModel Category=Privacy VLM2024.05 | 0.5 | 78 | 63 | 76 | 54 | 79 | |
| ShareGPTModel Category=Standard2024.05 | 0.47 | 70 | 56 | 47 | 70 | 94 | |
| InternVL-4BModel Category=Privacy VLM2024.05 | 0.46 | 77 | 59 | 90 | 44 | 63 | |
| InternVL-4BModel Category=Standard2024.05 | 0.42 | 65 | 47 | 35 | 74 | 96 | |
| InternVL-2BModel Category=Privacy VLM2024.05 | 0.37 | 67 | 50 | 45 | 56 | 89 | |
| MoELLaVAModel Category=Standard2024.05 | 0.35 | 67 | 50 | 47 | 52 | 86 | |
| TinyLLaVAModel Category=Standard2024.05 | 0.31 | 59 | 33 | 22 | 70 | 97 | |
| InternVL-2BModel Category=Standard2024.05 | 0.26 | 55 | 18 | 10 | 91 | 99 | |
| CoAgentModel Category=Standard2024.05 | 0.25 | 64 | 46 | 59 | 38 | 70 | |
| CogVLMModel Category=Standard2024.05 | 0.14 | 57 | 32 | 29 | 37 | 84 | |
| BLIPModel Category=Standard2024.05 | 0.05 | 51 | 10 | 6 | 34 | 97 | |
| GPT-4Model Category=Standard2024.05 | 0.01 | 50 | 2 | 1 | 28 | 99 | |
| OtterModel Category=Standard2024.05 | -0.03 | 48 | 37 | 83 | 23 | 14 | |
| FuyuModel Category=Standard2024.05 | -0.05 | 49 | 38 | 93 | 24 | 4 |