Privacy awareness classification on Biv-Priv (Evaluation)
45MCCLLaVA
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LLaVA2024.05 | 45 | 71 | 66 | 55 | 82 | 88 | |
| ShareGPT2024.05 | 44 | 70 | 64 | 53 | 82 | 88 | |
| MoELLaVA2024.05 | 41 | 70 | 73 | 80 | 67 | 60 | |
| BLIP2024.05 | 39 | 68 | 58 | 46 | 81 | 90 | |
| TinyLLaVA2024.05 | 37 | 68 | 67 | 64 | 70 | 73 | |
| GPT-42024.05 | 35 | 62 | 39 | 24 | 96 | 99 | |
| InternVL-2BModel Category=Privacy VLMs2024.05 | 33 | 64 | 49 | 35 | 81 | 92 | |
| InterlVL-4B2024.05 | 32 | 65 | 58 | 48 | 73 | 82 | |
| CoAgent2024.05 | 29 | 58 | 70 | 100 | 54 | 16 | |
| CogVLM2024.05 | 27 | 61 | 70 | 89 | 57 | 34 | |
| InternVL-2B2024.05 | 21 | 56 | 24 | 14 | 86 | 97 | |
| InterlVL-4BModel Category=Privacy VLMs2024.05 | 21 | 60 | 65 | 73 | 58 | 48 | |
| TinyLLaVaModel Category=Privacy VLMs2024.05 | 19 | 58 | 67 | 84 | 55 | 33 | |
| Otter2024.05 | 8 | 52 | 66 | 92 | 51 | 13 | |
| Fuyu2024.05 | 5 | 51 | 67 | 90 | 99 | 2 |