List your company

Indirect Prompt Injection Detection on Inj-SQuAD

0FPR (None)Llama-Guard3-8B
-0.1020.58651.2751.9635Feb 23, 2025

Evaluation results

MethodLinks
Llama-Guard3-8BInjected Position=Head2025.0200.662.440.661.112.55
Llama-Guard3-8BInjected Position=Middle2025.0200.221.880.111.661
Llama-Guard3-8BInjected Position=Tail2025.0209.6639.115.112.2212.55
Protect-AI-detectorInjected Position=Head2025.0200.1161.220.1111.1180.33
Protect-AI-detectorInjected Position=Middle2025.020044.880152.44
Protect-AI-detectorInjected Position=Tail2025.020043.7701.1152.55
Prompt-GuardInjected Position=Head2025.02090.7797.2290.7773.2292.11
Prompt-GuardInjected Position=Middle2025.02097.3399.7797.4499.8899.88
Prompt-GuardInjected Position=Tail2025.02083.4494.1183.4495.4497
Trained-DeBERTaInjected Position=Head2025.02099.8810099.8899.55100
Trained-DeBERTaInjected Position=Middle2025.02099.7710099.55100100
Trained-DeBERTaInjected Position=Tail2025.020100100100100100
Trained-Qwen2-0.5BInjected Position=Head2025.02095.3397.6693.5595.3397.44
Trained-Qwen2-0.5BInjected Position=Middle2025.02095.3398.1196.449698.55
Trained-Qwen2-0.5BInjected Position=Tail2025.02096.2299.2296.8897.5599.22
Trained-Qwen2-1.5BInjected Position=Head2025.02096.2298.5596.2296.7799
Trained-Qwen2-1.5BInjected Position=Middle2025.02095.4499.4497.5597.22100
Trained-Qwen2-1.5BInjected Position=Tail2025.02098.2210098.4498.8899.88
Qwen2-7B-InstructInjected Position=Head2025.020.6611.5524.881553.5575.11
Qwen2-7B-InstructInjected Position=Middle2025.020.6615.1164.5531.2264.7762.44
Qwen2-7B-InstructInjected Position=Tail2025.020.6639.3368.5540.662249.44
Llama3-8B-InstructInjected Position=Head2025.022.5533.7789.7740.6689.2299.66
Llama3-8B-InstructInjected Position=Middle2025.022.5549.8892.5565.4497.4495
Llama3-8B-InstructInjected Position=Tail2025.022.5592.5588.5582.7789.1174.11