Indirect Prompt Injection Detection on Inj-SQuAD benchmark leaderboard · SOTA2 Research

Indirect Prompt Injection Detection on Inj-SQuAD

0FPR (None)Llama-Guard3-8B

Evaluation Results

Method	Links
Llama-Guard3-8B2025.02		0	0.66	2.44	0.66	1.11	2.55
Llama-Guard3-8B2025.02		0	0.22	1.88	0.11	1.66	1
Llama-Guard3-8B2025.02		0	9.66	39.11	5.11	2.22	12.55
Protect-AI-detector2025.02		0	0.11	61.22	0.11	11.11	80.33
Protect-AI-detector2025.02		0	0	44.88	0	1	52.44
Protect-AI-detector2025.02		0	0	43.77	0	1.11	52.55
Prompt-Guard2025.02		0	90.77	97.22	90.77	73.22	92.11
Prompt-Guard2025.02		0	97.33	99.77	97.44	99.88	99.88
Prompt-Guard2025.02		0	83.44	94.11	83.44	95.44	97
Trained-DeBERTa2025.02		0	99.88	100	99.88	99.55	100
Trained-DeBERTa2025.02		0	99.77	100	99.55	100	100
Trained-DeBERTa2025.02		0	100	100	100	100	100
Trained-Qwen2-0.5B2025.02		0	95.33	97.66	93.55	95.33	97.44
Trained-Qwen2-0.5B2025.02		0	95.33	98.11	96.44	96	98.55
Trained-Qwen2-0.5B2025.02		0	96.22	99.22	96.88	97.55	99.22
Trained-Qwen2-1.5B2025.02		0	96.22	98.55	96.22	96.77	99
Trained-Qwen2-1.5B2025.02		0	95.44	99.44	97.55	97.22	100
Trained-Qwen2-1.5B2025.02		0	98.22	100	98.44	98.88	99.88
Qwen2-7B-Instruct2025.02		0.66	11.55	24.88	15	53.55	75.11
Qwen2-7B-Instruct2025.02		0.66	15.11	64.55	31.22	64.77	62.44
Qwen2-7B-Instruct2025.02		0.66	39.33	68.55	40.66	22	49.44
Llama3-8B-Instruct2025.02		2.55	33.77	89.77	40.66	89.22	99.66
Llama3-8B-Instruct2025.02		2.55	49.88	92.55	65.44	97.44	95
Llama3-8B-Instruct2025.02		2.55	92.55	88.55	82.77	89.11	74.11