Refusal Rate Evaluation on FBA (test)
13Refusal RateDEEPSEEK-R1-DISTILL-LLAMA-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| DEEPSEEK-R1-DISTILL-LLAMA-8BOnline Alignment=Offline Only, Offline SAT Variant=SafeDPO SAT2026.05 | 13 | |
| DEEPSEEK-R1-DISTILL-LLAMA-8BOnline Alignment=Offline Only, Offline SAT Variant=Base2026.05 | 14 | |
| LLAMA-3.2-1B-INSTRUCTOnline Alignment=Offline Only, Offline SAT Variant=Base2026.05 | 15 | |
| DEEPSEEK-R1-DISTILL-LLAMA-8BOnline Alignment=Offline Only, Offline SAT Variant=DPO SAT2026.05 | 15 | |
| DEEPSEEK-R1-DISTILL-QWEN-14BOnline Alignment=Offline Only, Offline SAT Variant=Base2026.05 | 16 | |
| DEEPSEEK-R1-DISTILL-QWEN-14BOnline Alignment=Offline Only, Offline SAT Variant=DPO SAT2026.05 | 18 | |
| DEEPSEEK-R1-DISTILL-QWEN-14BOnline Alignment=Offline Only, Offline SAT Variant=SafeDPO SAT2026.05 | 19 | |
| LLAMA-3.2-1B-INSTRUCTOnline Alignment=RAG-Pref, Offline SAT Variant=Base2026.05 | 28 | |
| LLAMA-3.2-1B-INSTRUCTOnline Alignment=Offline Only, Offline SAT Variant=DPO SAT2026.05 | 31 | |
| Gemma-2-2B-ITOnline Alignment=Offline Only, Offline SAT Variant=Base2026.05 | 32 | |
| LLAMA-3.1-8B-INSTRUCTOnline Alignment=Offline Only, Offline SAT Variant=Base2026.05 | 35 | |
| LLAMA-3.1-8B-INSTRUCTOnline Alignment=OPAD, Offline SAT Variant=SafeDPO SAT2026.05 | 37 | |
| LLAMA-3.2-1B-INSTRUCTOnline Alignment=Offline Only, Offline SAT Variant=SafeDPO SAT2026.05 | 40 | |
| DEEPSEEK-R1-DISTILL-QWEN-14BOnline Alignment=OPAD, Offline SAT Variant=Base2026.05 | 41 | |
| LLAMA-3.1-8B-INSTRUCTOnline Alignment=Offline Only, Offline SAT Variant=DPO SAT2026.05 | 43 | |
| LLAMA-3.1-8B-INSTRUCTOnline Alignment=OPAD, Offline SAT Variant=Base2026.05 | 43 | |
| DEEPSEEK-R1-DISTILL-LLAMA-8BOnline Alignment=OPAD, Offline SAT Variant=Base2026.05 | 44 | |
| DEEPSEEK-R1-DISTILL-QWEN-14BOnline Alignment=OPAD, Offline SAT Variant=DPO SAT2026.05 | 44 | |
| Gemma-2-2B-ITOnline Alignment=Offline Only, Offline SAT Variant=DPO SAT2026.05 | 45 | |
| LLAMA-3.1-8B-INSTRUCTOnline Alignment=Offline Only, Offline SAT Variant=SafeDPO SAT2026.05 | 45 | |
| DEEPSEEK-R1-DISTILL-LLAMA-8BOnline Alignment=OPAD, Offline SAT Variant=SafeDPO SAT2026.05 | 45 | |
| DEEPSEEK-R1-DISTILL-QWEN-14BOnline Alignment=OPAD, Offline SAT Variant=SafeDPO SAT2026.05 | 46 | |
| Gemma-2-2B-ITOnline Alignment=Offline Only, Offline SAT Variant=SafeDPO SAT2026.05 | 47 | |
| LLAMA-3.1-8B-INSTRUCTOnline Alignment=OPAD, Offline SAT Variant=DPO SAT2026.05 | 47 | |
| DEEPSEEK-R1-DISTILL-LLAMA-8BOnline Alignment=OPAD, Offline SAT Variant=DPO SAT2026.05 | 47 | |
| LLAMA-3.2-1B-INSTRUCTOnline Alignment=RAG-Pref, Offline SAT Variant=DPO SAT2026.05 | 58 | |
| LLAMA-3.2-1B-INSTRUCTOnline Alignment=OPAD, Offline SAT Variant=Base2026.05 | 59 | |
| DEEPSEEK-R1-DISTILL-LLAMA-8BOnline Alignment=RAG-Pref, Offline SAT Variant=Base2026.05 | 59 | |
| DEEPSEEK-R1-DISTILL-LLAMA-8BOnline Alignment=RAG-Pref, Offline SAT Variant=DPO SAT2026.05 | 59 | |
| DEEPSEEK-R1-DISTILL-LLAMA-8BOnline Alignment=RAG-Pref, Offline SAT Variant=SafeDPO SAT2026.05 | 59 | |
| LLAMA-3.2-1B-INSTRUCTOnline Alignment=OPAD, Offline SAT Variant=DPO SAT2026.05 | 61 | |
| Gemma-2-2B-ITOnline Alignment=RAG-Pref, Offline SAT Variant=Base2026.05 | 63 | |
| DEEPSEEK-R1-DISTILL-QWEN-14BOnline Alignment=RAG-Pref, Offline SAT Variant=Base2026.05 | 64 | |
| DEEPSEEK-R1-DISTILL-QWEN-14BOnline Alignment=RAG-Pref, Offline SAT Variant=SafeDPO SAT2026.05 | 64 | |
| LLAMA-3.2-1B-INSTRUCTOnline Alignment=OPAD, Offline SAT Variant=SafeDPO SAT2026.05 | 66 | |
| DEEPSEEK-R1-DISTILL-QWEN-14BOnline Alignment=RAG-Pref, Offline SAT Variant=DPO SAT2026.05 | 68 | |
| Gemma-2-2B-ITOnline Alignment=RAG-Pref, Offline SAT Variant=DPO SAT2026.05 | 74 | |
| Gemma-2-2B-ITOnline Alignment=RAG-Pref, Offline SAT Variant=SafeDPO SAT2026.05 | 75 | |
| LLAMA-3.2-1B-INSTRUCTOnline Alignment=RAG-Pref, Offline SAT Variant=SafeDPO SAT2026.05 | 88 | |
| LLAMA-3.1-8B-INSTRUCTOnline Alignment=RAG-Pref, Offline SAT Variant=Base2026.05 | 95 | |
| LLAMA-3.1-8B-INSTRUCTOnline Alignment=RAG-Pref, Offline SAT Variant=DPO SAT2026.05 | 97 | |
| LLAMA-3.1-8B-INSTRUCTOnline Alignment=RAG-Pref, Offline SAT Variant=SafeDPO SAT2026.05 | 97 |