Safety and Informativeness Evaluation on PKU-SafeRLHF (test)
85.3Drugs & Weapons Safety ScoreSafeMoE-XL
Evaluation Results
| Method | Links | ||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SafeMoE-XLBackbone=Mistral-7B, MoE Configuration=XL, Routing Strategy=top-2, LoRA Rank=32, LoRA Alpha=642026.05 | 85.3 | 8 | 94 | 8.1 | 87.9 | 8.3 | 94.4 | 8.1 | 97.1 | 8.2 | 92.3 | 7.9 | 89.9 | 7.9 | 85.2 | 8 | 80.7 | 8.1 | 95.2 | 8.1 | 94.9 | 8 | 93.1 | 8.6 | 90.1 | 8.3 | 89.3 | 8.2 | 90.7 | 8.2 | 93.8 | 8.1 | 88.3 | 8 | 89.3 | 8 | 94.4 | 8.1 | 90.8 | 8.1 | |
| SafeMoE-LBackbone=Mistral-7B, MoE Configuration=L, Routing Strategy=top-2, LoRA Rank=32, LoRA Alpha=642026.05 | 84.4 | 8 | 92.5 | 8.1 | 87.4 | 8.3 | 94.8 | 8.2 | 94 | 8.1 | 94.8 | 7.9 | 86.7 | 7.8 | 84.8 | 7.9 | 81.6 | 8.2 | 89.9 | 8.1 | 95.7 | 8.2 | 87.3 | 8.5 | 93.5 | 8 | 87.2 | 8 | 90.9 | 8.2 | 93.4 | 8.1 | 87.4 | 8.2 | 92 | 8.2 | 93.9 | 8 | 90.1 | 8.1 | |
| SafeMoE-4Backbone=Mistral-7B, MoE Configuration=4, Number of Experts=4, Routing Strategy=top-2, LoRA Rank=32, LoRA Alpha=642026.05 | 73.5 | 7.3 | 86.9 | 7.8 | 79.8 | 7.2 | 93.7 | 7.8 | 92 | 7.6 | 96 | 7.6 | 88 | 7.4 | 80.6 | 7.6 | 76.5 | 7.6 | 85 | 7.6 | 94 | 7.9 | 81.7 | 7.7 | 92.9 | 7.7 | 81.4 | 7.7 | 82.3 | 7.8 | 88.9 | 7.6 | 88.2 | 7.6 | 89.9 | 7.8 | 92 | 7.6 | 86.5 | 7.6 | |
| SafeMoE-QwenBackbone=Qwen-3B, MoE Configuration=XL, Routing Strategy=top-2, LoRA Rank=32, LoRA Alpha=642026.05 | 49.4 | 7.31 | 58.2 | 7.11 | 65.1 | 7.17 | 84 | 7.71 | 63.4 | 7.12 | 53.8 | 7.08 | 60.7 | 7.49 | 54 | 7.36 | 61.3 | 7.2 | 60.7 | 7.25 | 50 | 7.35 | 63.3 | 7.78 | 65.5 | 7.44 | 67.1 | 7.61 | 63.4 | 7.25 | 71.1 | 7.22 | 68.3 | 7.65 | 65.1 | 7.52 | 60 | 7.15 | 62.4 | 7.6 | |
| Mistral-7BBackbone=Mistral-7B2026.05 | 18.1 | 5.4 | 16.5 | 6 | 9.2 | 4.8 | 20.5 | 5.5 | 26.1 | 6.1 | 27.1 | 5.5 | 17.1 | 5.6 | 14.2 | 5.8 | 11.5 | 4.6 | 20.2 | 5.5 | 23.1 | 5.9 | 14.3 | 6.6 | 16.8 | 5.6 | 12 | 6.4 | 16.4 | 5 | 11.1 | 5.1 | 24.8 | 5.9 | 13.2 | 4.9 | 18.2 | 6.3 | 17.4 | 5.6 | |
| QwenBackbone=Qwen-3B2026.05 | 8.7 | 7.17 | 12.2 | 6.2 | 7.6 | 6.6 | 10.1 | 7.2 | 7.5 | 6.2 | 11.4 | 6.44 | 13.9 | 6.18 | 9.8 | 6.33 | 3.5 | 8 | 8 | 7.5 | 13.7 | 6.7 | 12.1 | 8.25 | 19.2 | 7.07 | 12.7 | 7.22 | 21 | 7 | 19 | 6.7 | 8.9 | 6.8 | 11 | 6.6 | 10.1 | 7.1 | 11.6 | 6.9 |