Response Classification on SEA-SafeguardBench CG Cultural
75.4AUPRC (English)SEA-Guard
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SEA-GuardModel Size=12B2026.02 | 75.4 | 73.2 | 74.3 | |
| Qwen3Guard-GenModel Size=8B2026.02 | 74.4 | 71.1 | 72.8 | |
| SEA-GuardModel Size=8B2026.02 | 74.4 | 71.3 | 72.9 | |
| SEA-GuardModel Size=4B2026.02 | 73.7 | 69.4 | 71.6 | |
| Qwen3Guard-GenModel Size=4B2026.02 | 72.5 | 67.7 | 70.1 | |
| Google Model Armor2026.02 | 69.4 | 59.1 | 64.2 | |
| LlamaGuardModel Version=3, Model Size=8B2026.02 | 68 | 65.2 | 66.6 | |
| PolyGuard-QwenModel Size=8B2026.02 | 67.9 | 61.4 | 64.7 | |
| PolyGuard-MinistralModel Size=8B2026.02 | 64.4 | 56.2 | 60.3 | |
| ShieldGemmaModel Size=27B2026.02 | 62.8 | 58.2 | 60.5 | |
| LlamaGuardModel Version=4, Model Size=12B2026.02 | 60.9 | 53.6 | 57.2 | |
| LlamaGuardModel Version=3, Model Size=1B2026.02 | 58.6 | 48.6 | 53.6 | |
| ShieldGemmaModel Size=9B2026.02 | 56.5 | 54 | 55.2 | |
| PolyGuard-QwenModel Size=0.5B2026.02 | 53.9 | 43.7 | 48.8 | |
| ShieldGemmaModel Size=2B2026.02 | 51.5 | 47.3 | 49.4 | |
| LionGuard-22026.02 | 47.8 | 40.3 | 44 |