Video Moderation on SafeWatch-GenAI (test)
100Sexual AccuracyOmniGuard-7B
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| OmniGuard-7BModel Source Type=Guardrails2026.05 | 100 | 22.4 | 41.3 | 20.9 | 47.5 | 15 | 85.3 | 47.5 | 43.3 | |
| Gemma4-31BModel Source Type=Open-source2026.05 | 97 | 30.4 | 81.1 | 29.3 | 60.2 | 54.8 | 87.1 | 62.9 | 61.9 | |
| QwenGuard-7BModel Source Type=Guardrails2026.05 | 96.6 | 4.3 | 32.3 | 0 | 48.7 | 0 | 82.1 | 37.7 | 29.7 | |
| Qwen3-VL-2B-ftModel Source Type=Open-source, Fine-tuning status=fine-tuned2026.05 | 96.2 | 26.8 | 68.7 | 85.3 | 51.3 | 86 | 45 | 65.6 | 64.3 | |
| GPT-5.4Model Source Type=Closed-source2026.05 | 94 | 28.3 | 84.1 | 16.4 | 52.6 | 47.6 | 90.8 | 59.1 | 57.9 | |
| Qwen3.5-27BModel Source Type=Open-source2026.05 | 93.6 | 22.9 | 83.6 | 24 | 51.9 | 7.1 | 86.6 | 52.8 | 48.8 | |
| SAFELENS-S1Model Source Type=Ours2026.05 | 93.6 | 52.2 | 64.2 | 52 | 73.1 | 88.8 | 87.6 | 73.1 | 72.6 | |
| OmniGuard-3B-ftModel Source Type=Guardrails, Fine-tuning status=fine-tuned2026.05 | 92.7 | 47.1 | 68.7 | 88.9 | 52.6 | 88.5 | 35.2 | 67.7 | 64.7 | |
| SAFELENS-S2Model Source Type=Ours2026.05 | 92.3 | 62.3 | 65.7 | 77.8 | 70.5 | 89.8 | 78.4 | 76.7 | 75.3 | |
| SAFELENSModel Source Type=Ours2026.05 | 92.3 | 62.3 | 65.7 | 76.4 | 70.5 | 89.8 | 79.5 | 76.7 | 75.3 | |
| SafeWatch-8BModel Source Type=Guardrails2026.05 | 88 | 30.4 | 71.1 | 50.2 | 23.1 | 62.9 | 90.8 | 59.5 | 61.4 | |
| Gemini-3.1-proModel Source Type=Closed-source2026.05 | 86.8 | 22.5 | 73.1 | 25.3 | 51.3 | 64.6 | 88.5 | 58.9 | 59.4 | |
| Qwen3-VL-2BModel Source Type=Open-source2026.05 | 86.3 | 0 | 80.1 | 3.1 | 3.8 | 0 | 95.6 | 38.4 | 30.3 | |
| OmniGuard-3BModel Source Type=Guardrails2026.05 | 82.5 | 21 | 32.4 | 40.9 | 56.4 | 30.6 | 69.4 | 47.6 | 45.2 |