Harmlessness on Stereotype
99.03Refusal RateDR-IRL
Evaluation results
| Method | Links | |
|---|---|---|
| DR-IRLBackbone=Qwen-2-7B-Instruct2025.03 | 99.03 | |
| STAIRBackbone=Qwen-2-7B-Instruct2025.03 | 98.95 | |
| DR-IRLBackbone=Llama-3.1-8B-Instruct2025.03 | 98.87 | |
| IRLBackbone=Qwen-2-7B-Instruct2025.03 | 98.04 | |
| DPOBackbone=Llama-3.1-8B-Instruct2025.03 | 97.89 | |
| IRLBackbone=Llama-3.1-8B-Instruct2025.03 | 97.54 | |
| GRPOBackbone=Qwen-2-7B-Instruct2025.03 | 97.41 | |
| GRPOBackbone=Llama-3.1-8B-Instruct2025.03 | 96.91 | |
| SACPOBackbone=Llama-3.1-8B-Instruct2025.03 | 96.84 | |
| STAIRBackbone=Llama-3.1-8B-Instruct2025.03 | 96.84 | |
| SACPOBackbone=Qwen-2-7B-Instruct2025.03 | 95.79 | |
| SFTBackbone=Llama-3.1-8B-Instruct2025.03 | 94.74 | |
| Self-RewardingBackbone=Llama-3.1-8B-Instruct2025.03 | 94.74 | |
| Self-RewardingBackbone=Qwen-2-7B-Instruct2025.03 | 94.74 | |
| SFTBackbone=Qwen-2-7B-Instruct2025.03 | 91.58 | |
| BaseBackbone=Qwen-2-7B-Instruct2025.03 | 90.53 | |
| CoTBackbone=Qwen-2-7B-Instruct2025.03 | 88.42 | |
| DPOBackbone=Qwen-2-7B-Instruct2025.03 | 88.42 | |
| BaseBackbone=Llama-3.1-8B-Instruct2025.03 | 87.37 | |
| CoTBackbone=Llama-3.1-8B-Instruct2025.03 | 65.26 |