Policy Violation Detection on SafeAgentBench
234True PositivesVIGIL
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VIGILTests=5462026.06 | 234 | 4 | 98.3 | 94.4 | 96.3 | |
| AgentSpecTests=5462026.06 | 231 | 2 | 99.1 | 93.1 | 96 | |
| LLM-as-judgeTests=5462026.06 | 222 | 41 | 84.4 | 89.5 | 86.9 |
| Method | Links | |||||
|---|---|---|---|---|---|---|
| VIGILTests=5462026.06 | 234 | 4 | 98.3 | 94.4 | 96.3 | |
| AgentSpecTests=5462026.06 | 231 | 2 | 99.1 | 93.1 | 96 | |
| LLM-as-judgeTests=5462026.06 | 222 | 41 | 84.4 | 89.5 | 86.9 |