Safety Evaluation on HarmfulQA v1 (test)
16.8Compliance RateDeepSeek-R1-Distill-Qwen-7B
Evaluation results
| Method | Links | |
|---|---|---|
| DeepSeek-R1-Distill-Qwen-7BModel Category=Local, Evaluation Protocol=LLM-as-a-Judge2025.07 | 16.8 | |
| Qwen2.5-7B-InstructModel Category=Local, Evaluation Protocol=LLM-as-a-Judge2025.07 | 8.8 | |
| STAR-1Model Category=Local, Evaluation Protocol=LLM-as-a-Judge2025.07 | 3.2 | |
| o1Model Category=API-based, Evaluation Protocol=LLM-as-a-Judge2025.07 | 2.2 | |
| STAIR-DPOModel Category=Local, Evaluation Protocol=LLM-as-a-Judge2025.07 | 1.2 | |
| ARMOR-ThinkModel Category=Local, Evaluation Protocol=LLM-as-a-Judge2025.07 | 1.2 | |
| STAIR-SFTModel Category=Local, Evaluation Protocol=LLM-as-a-Judge2025.07 | 0.8 | |
| o3-miniModel Category=API-based, Evaluation Protocol=LLM-as-a-Judge2025.07 | 0.6 | |
| ARMORModel Category=Local, Evaluation Protocol=LLM-as-a-Judge2025.07 | 0 |