List your company

Indirect Prompt Injection Detection on TriviaQA Inj

0.22FPR (None)Prompt-Guard
-2.815617.674738.16558.6553Feb 23, 2025

Evaluation results

MethodLinks
Prompt-GuardInjected Position=Head2025.020.2277.7785.6677.7739.5573.66
Prompt-GuardInjected Position=Middle2025.020.2288.6694.3389.338692.88
Prompt-GuardInjected Position=Tail2025.020.226978.556970.8878.33
Protect-AI-detectorInjected Position=Head2025.020.660.3343.770.332.8863.88
Protect-AI-detectorInjected Position=Middle2025.020.660.3328.550.330.4429.22
Protect-AI-detectorInjected Position=Tail2025.020.660.2223.220.220.4427.88
Llama-Guard3-8BInjected Position=Head2025.0212.8852.882.114
Llama-Guard3-8BInjected Position=Middle2025.02112.221.2222.44
Llama-Guard3-8BInjected Position=Tail2025.0216.7729.3396.6616.44
Trained-Qwen2-1.5BInjected Position=Head2025.0211.1190.229793.1194.7798
Trained-Qwen2-1.5BInjected Position=Middle2025.0211.1194.11999797.2299.55
Trained-Qwen2-1.5BInjected Position=Tail2025.0211.1199.1110099.3399.66100
Trained-DeBERTaInjected Position=Head2025.0212.4498.1110098.1192.2299.88
Trained-DeBERTaInjected Position=Middle2025.0212.4499.5510099.6699.88100
Trained-DeBERTaInjected Position=Tail2025.0212.4499.7710099.7799.88100
Trained-Qwen2-0.5BInjected Position=Head2025.0227.339697.5594.6695.4497.33
Trained-Qwen2-0.5BInjected Position=Middle2025.0227.339598.2297.6697.4498.88
Trained-Qwen2-0.5BInjected Position=Tail2025.0227.3397.5599.6697.6698.5599.55
Qwen2-7B-InstructInjected Position=Head2025.0234.3332.2244.1135.3339.5561.11
Qwen2-7B-InstructInjected Position=Middle2025.0234.3347.5566.665866.7764
Qwen2-7B-InstructInjected Position=Tail2025.0234.3358.5560.6655.2247.2263.33
Llama3-8B-InstructInjected Position=Head2025.0276.1196.8897.7796.11100100
Llama3-8B-InstructInjected Position=Middle2025.0276.118492.4486.3398.5597.11
Llama3-8B-InstructInjected Position=Tail2025.0276.1189.2291.8884.3397.4492.88