Refusal on SaladBench
93.04ScoreICL
Evaluation results
| Method | Links | |
|---|---|---|
| ICLBackbone=Llama-3.1-8B-Instruct2026.02 | 93.04 | |
| STEER2ADAPTBackbone=Llama-3.1-8B-Instruct2026.02 | 91.84 | |
| REPBackbone=Llama-3.1-8B-Instruct2026.02 | 90.46 | |
| STEER2ADAPTBackbone=Qwen-2.5-7B-Instruct2026.02 | 88.52 | |
| ICLBackbone=Qwen-2.5-7B-Instruct2026.02 | 87.32 | |
| Direct InferenceBackbone=Llama-3.1-8B-Instruct2026.02 | 86.54 | |
| Few-ShotBackbone=Qwen-2.5-7B-Instruct, n=22026.02 | 85.9 | |
| CAABackbone=Llama-3.1-8B-Instruct2026.02 | 84.91 | |
| Few-ShotBackbone=Qwen-2.5-7B-Instruct, n=12026.02 | 81.12 | |
| Direct InferenceBackbone=Qwen-2.5-7B-Instruct2026.02 | 80.52 | |
| STEER2ADAPTBackbone=Mistral-7B-Instruct-v0.12026.02 | 79.22 | |
| REPBackbone=Qwen-2.5-7B-Instruct2026.02 | 79.21 | |
| ICLBackbone=Mistral-7B-Instruct-v0.12026.02 | 75.89 | |
| REPBackbone=Mistral-7B-Instruct-v0.12026.02 | 74.92 | |
| Few-ShotBackbone=Llama-3.1-8B-Instruct, n=12026.02 | 74.24 | |
| CAABackbone=Qwen-2.5-7B-Instruct2026.02 | 61.29 | |
| Few-ShotBackbone=Llama-3.1-8B-Instruct, n=22026.02 | 55.29 | |
| CAABackbone=Mistral-7B-Instruct-v0.12026.02 | 51.87 | |
| Direct InferenceBackbone=Mistral-7B-Instruct-v0.12026.02 | 49.73 | |
| Few-ShotBackbone=Mistral-7B-Instruct-v0.1, n=22026.02 | 36.99 | |
| Few-ShotBackbone=Mistral-7B-Instruct-v0.1, n=12026.02 | 36.78 |