Trajectory Auditing on AFTRAJ-2K (D_safe D_unsafe)
2.37False Alarm Rate (FAR)AgentForesight-7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AgentForesight-7BModel Category=Ours2026.05 | 2.37 | 59.51 | |
| DeepSeek-V4-ProModel Category=Proprietary LLMs2026.05 | 43.2 | 53.99 | |
| Qwen2.5-7B-InstructModel Category=Open-Source LLMs2026.05 | 46.15 | 36.2 | |
| Qwen3-8BModel Category=Open-Source LLMs2026.05 | 56.8 | 38.04 | |
| DeepSeek-V4-FlashModel Category=Proprietary LLMs2026.05 | 59.76 | 47.24 | |
| Gemini-3-FlashModel Category=Proprietary LLMs2026.05 | 67.86 | 38.04 | |
| Claude-Haiku-4.5Model Category=Proprietary LLMs2026.05 | 68.64 | 33.13 | |
| GPT-4.1Model Category=Proprietary LLMs2026.05 | 85.8 | 38.04 | |
| Llama3.2-3BModel Category=Open-Source LLMs2026.05 | 90.53 | 20.86 | |
| Gemma3-4BModel Category=Open-Source LLMs2026.05 | 97.63 | 10.43 |