List your company

Prompt Injection Attack Robustness on SAP10 2023a (test)

61Attack Success Percentage (ASP)Hypnotism
54.96856.53458.159.666May 20, 2025

Evaluation results

MethodLinks
HypnotismAttack Method=Hypnotism, Model Group=Open-source LLMs (Mean)2025.056157.8
Ignore PrefixAttack Method=Ignore Prefix, Model Group=Open-source LLMs (Mean)2025.0560.858.3
Role-playing CoTAttack Method=Role-playing CoT, Model Group=Open-source LLMs (Mean)2025.0555.254.3