Vision-text safety classification on MSSBench Chat
52.07AUPRC (Prompt)SEA-Guard-8B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SEA-Guard-8BZero-shot=true2026.02 | 52.07 | 72.41 | |
| SEA-Guard-12BZero-shot=true2026.02 | 51.82 | 71.58 | |
| SEA-Guard-4BZero-shot=true2026.02 | 51.18 | 69.07 | |
| Qwen3-VL-4B-ITZero-shot=true2026.02 | 50.5 | 61.1 | |
| Qwen3-VL-8B-ITZero-shot=true2026.02 | 50.28 | 65.1 | |
| Gemma3-12B-ITZero-shot=true2026.02 | 50.1 | 70 | |
| SEA-LION-v4-Qwen-VLZero-shot=true2026.02 | 50 | 57.24 | |
| SEA-LION-v4-Qwen-VLZero-shot=true, variant=v22026.02 | 50 | 55.63 | |
| Gemma3-4B-ITZero-shot=true2026.02 | 49.86 | 70.39 |