List your company

Agent Safety Evaluation on AgentHarm (held-out)

12.5HCRFATE
10.12426.16242.258.238May 12, 2026

Evaluation results

MethodLinks
FATEBackbone=Qwen3-8B-Instruct2026.0512.581.287
FATEBackbone=Ministral-3-8B-Instruct2026.0514.179.785.8
FATEBackbone=Llama-3.1-8B-Instruct2026.0515.678.184.2
FATEBackbone=Phi-4-reasoning2026.0516.478.183.6
FATEBackbone=Gemma-3-12B-it2026.0517.276.682.1
BaseBackbone=Gemma-3-12B-it2026.0562.523.433.7
BaseBackbone=Ministral-3-8B-Instruct2026.0564.121.931.4
BaseBackbone=Llama-3.1-8B-Instruct2026.0567.218.828.6
BaseBackbone=Phi-4-reasoning2026.0568.820.330.1
BaseBackbone=Qwen3-8B-Instruct2026.0571.915.624.1