List your company

Prompt-Response Safety Routing on HarmBench

55.92Routing F1SafeRoute
17.835227.722637.6147.4974Feb 18, 2025

Evaluation results

MethodLinks
SafeRoutesmall_model=Llama-Guard-3-1B, large_model=Granite-Guardian-3-8B2025.0255.92
SafeRouteProtocol=Prompt-Response, Small Model=Llama-Guard-3-1B, Large Model=Llama-Guard-3-8B2025.0251.24
Entropysmall_model=Llama-Guard-3-1B, large_model=Granite-Guardian-3-8B2025.0243.45
EntropyProtocol=Prompt-Response, Small Model=Llama-Guard-3-1B, Large Model=Llama-Guard-3-8B2025.0240.94
+CCsmall_model=Llama-Guard-3-1B, large_model=Granite-Guardian-3-8B2025.0238.28
CCProtocol=Prompt-Response, Small Model=Llama-Guard-3-1B, Large Model=Llama-Guard-3-8B2025.0237.86
BCProtocol=Prompt-Response, Small Model=Llama-Guard-3-1B, Large Model=Llama-Guard-3-8B2025.0232.62
+BCsmall_model=Llama-Guard-3-1B, large_model=Granite-Guardian-3-8B2025.0228.46
+TSsmall_model=Llama-Guard-3-1B, large_model=Granite-Guardian-3-8B2025.0222.64
TSProtocol=Prompt-Response, Small Model=Llama-Guard-3-1B, Large Model=Llama-Guard-3-8B2025.0219.3