Injection Detection on Synthetic Educational AI Programming Tutor (holdout)
0Bypass RateNeMo Guardrails
Evaluation results
| Method | Links | ||
|---|---|---|---|
| NeMo GuardrailsAvg Latency (ms)=1381.83, p95 Latency (ms)=4503.172026.03 | 0 | 16.22 | |
| Prompt GuardAvg Latency (ms)=70.62, p95 Latency (ms)=83.342026.03 | 38.48 | 3.6 | |
| Multi-LayerAvg Latency (ms)=2.50, p95 Latency (ms)=4.072026.03 | 46.34 | 0 | |
| Layer 1 OnlyAvg Latency (ms)=0.03, p95 Latency (ms)=0.032026.03 | 69.65 | 0 | |
| No DefenseAvg Latency (ms)=0.00, p95 Latency (ms)=0.002026.03 | 100 | 0 |