List your company
ResearchFormerly WizWand

Over-refusal Evaluation on Over-refusal (test)

0Refusal RateNo train
-2.89616.65236.255.748Apr 21, 2026
Updated 6mo ago

Evaluation results

MethodLinks
No trainBackbone=R1-7B, Dataset Size=-, Temperature=0.02026.040
SafeChainBackbone=R1-14B, Dataset Size=40K, Temperature=0.02026.040
SafeChainBackbone=R1-14B, Dataset Size=1K, Temperature=0.02026.040
No trainBackbone=R1-32B, Dataset Size=-, Temperature=0.02026.040
SafeChainBackbone=R1-32B, Dataset Size=1K, Temperature=0.02026.040
No trainBackbone=s1-3B, Dataset Size=-, Temperature=0.02026.040
No trainBackbone=s1-14B, Dataset Size=-, Temperature=0.02026.040
SafeChainBackbone=R1-1.5B, Dataset Size=40k, Temperature=0.02026.040.4
SafeChainBackbone=R1-7B, Dataset Size=1K, Temperature=0.02026.040.4
No trainBackbone=R1-8B, Dataset Size=-, Temperature=0.02026.040.4
SafeChainBackbone=R1-8B, Dataset Size=40K, Temperature=0.02026.040.4
SafeChainBackbone=R1-32B, Dataset Size=40K, Temperature=0.02026.040.4
SafeChainBackbone=s1-3B, Dataset Size=1K, Temperature=0.02026.040.4
SafeChainBackbone=s1-14B, Dataset Size=1K, Temperature=0.02026.040.4
SafeChainBackbone=R1-7B, Dataset Size=40K, Temperature=0.02026.040.8
SafeChainBackbone=R1-8B, Dataset Size=1K, Temperature=0.02026.040.8
No trainBackbone=R1-14B, Dataset Size=-, Temperature=0.02026.040.8
No trainBackbone=R1-1.5B, Dataset Size=-, Temperature=0.02026.042
SafeChainBackbone=R1-1.5B, Dataset Size=1K, Temperature=0.02026.042.8
S1-ALTBackbone=s1-3B, Dataset Size=1K, Temperature=0.02026.046
STAR-1Backbone=R1-32B, Dataset Size=1K, Temperature=0.02026.049.6
STAR-1Backbone=R1-14B, Dataset Size=1K, Temperature=0.02026.0410.4
R1-ALTBackbone=R1-32B, Dataset Size=1K, Temperature=0.02026.0411.2
R1-ALTBackbone=R1-8B, Dataset Size=1K, Temperature=0.02026.0414
S1-ALTBackbone=s1-14B, Dataset Size=1K, Temperature=0.02026.0414
DirectRefusalBackbone=R1-14B, Dataset Size=1k, Temperature=0.02026.0414.8
DirectRefusalBackbone=R1-32B, Dataset Size=1k, Temperature=0.02026.0415.6
DirectRefusalBackbone=R1-8B, Dataset Size=1k, Temperature=0.02026.0418.8
R1-ALTBackbone=R1-14B, Dataset Size=1K, Temperature=0.02026.0420.8
STAR-1Backbone=R1-8B, Dataset Size=1K, Temperature=0.02026.0421.2
DirectRefusalBackbone=R1-7B, Dataset Size=1k, Temperature=0.02026.0429.2
STAR-1Backbone=R1-7B, Dataset Size=1K, Temperature=0.02026.0430
R1-ALTBackbone=R1-7B, Dataset Size=1K, Temperature=0.02026.0431.6
STAR-1Backbone=R1-1.5B, Dataset Size=1K, Temperature=0.02026.0464
R1-ALTBackbone=R1-1.5B, Dataset Size=1K, Temperature=0.02026.0469.6
DirectRefusalBackbone=R1-1.5B, Dataset Size=1k, Temperature=0.02026.0472.4