Safety Evaluation on ImageGuard privacy subset (test)
87.5F1 ScoreImageGuard
Evaluation results
| Method | Links | |
|---|---|---|
| ImageGuard2025.01 | 87.5 | |
| Claude3.5-sonnet2025.01 | 55.2 | |
| GPT-4o2025.01 | 35.6 | |
| Idefics22025.01 | 21.2 | |
| Gemini1.5-pro2025.01 | 6 | |
| LlavaGuard2025.01 | 0 | |
| LlavaNext2025.01 | 0 | |
| InternVL22025.01 | 0 |