Violation Detection on StepShield (main)
18EIRConstraintGuard
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ConstraintGuardType=Constraint checking, Latency=~5ms per step2026.01 | 18 | 25 | 50 | 29 | 10.9 | |
| StaticGuardType=Pattern-matching, Latency=<1ms per step2026.01 | 26 | 42 | 56 | 41 | 16.7 | |
| HybridGuardType=Cascaded detector, Latency=~75ms per step, Cost=~$0.003 per trajectory2026.01 | 41 | 85 | 66 | 62 | 24.9 | |
| LLMJudgeModel=GPT-4.1-mini, Latency=~500ms per step, Cost=~$0.02 per trajectory2026.01 | 59 | 20 | 63 | 63 | 35.8 |