Safety Evaluation on SST
100Safety ScoreClaude-3.7-Sonnet
Evaluation Results
| Method | Links | |
|---|---|---|
| Claude-3.7-SonnetEvaluation Source=HELM2025.01 | 100 | |
| Qwen2.5 Instruct (72B)Evaluation Source=HELM2025.01 | 100 | |
| o1 (2024-12-17)Evaluation Source=HELM2025.01 | 99 | |
| GPT-4o (2024-05-13)Evaluation Source=HELM2025.01 | 98.5 | |
| DeepSeek-R1Evaluation Source=HELM, Chain of Thought=hidden, Risk Control System=Enabled2025.01 | 98 | |
| DeepSeek-R1Evaluation Source=HELM, Chain of Thought=visible, Risk Control System=Enabled2025.01 | 97.5 | |
| DeepSeek-V3Evaluation Source=HELM, Risk Control System=Enabled2025.01 | 95.3 |