Answer Accuracy on Alpaca
40.6BRT AccuracyNo Attack
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| No AttackStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 40.6 | 99.2 | |
| BPDStructure=Hierarchy, Model=GPT-4o2025.10 | 40.2 | 98.8 | |
| No AttackStructure=Hierarchy, Model=GPT-4o2025.10 | 40 | 99.4 | |
| No AttackStructure=Flat, Backbone=DeepSeek-V32025.10 | 39.9 | 99.2 | |
| Single LLMStructure=Single LLM, Backbone=DeepSeek-V32025.10 | 39.8 | 97.2 | |
| BPDStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 39.8 | 98.8 | |
| No AttackStructure=Flat, Model=GPT-4o2025.10 | 39.8 | 99.4 | |
| BPDStructure=Flat, Model=GPT-4o2025.10 | 39.6 | 99.6 | |
| BPDStructure=Flat, Backbone=DeepSeek-V32025.10 | 39.4 | 99 | |
| Single LLMStructure=Single LLM, Model=GPT-4o2025.10 | 39.4 | 97.2 | |
| ChallengerStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 38.9 | 95 | |
| G-SafeguardStructure=Flat, Model=GPT-4o2025.10 | 38.6 | 97 | |
| G-SafeguardStructure=Hierarchy, Model=GPT-4o2025.10 | 38.4 | 97.2 | |
| G-SafeguardStructure=Flat, Backbone=DeepSeek-V32025.10 | 38.2 | 97 | |
| G-SafeguardStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 38.2 | 96.6 | |
| AGENTXPOSEDStructure=Hierarchy, Model=GPT-4o2025.10 | 37.9 | 96.2 | |
| AGENTXPOSEDStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 37.6 | 95.4 | |
| AGENTXPOSEDStructure=Flat, Backbone=DeepSeek-V32025.10 | 37.5 | 95.2 | |
| InspectorStructure=Flat, Backbone=DeepSeek-V32025.10 | 37.2 | 91.4 | |
| AGENTXPOSEDStructure=Flat, Model=GPT-4o2025.10 | 37 | 95.2 | |
| InspectorStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 35.7 | 92.6 | |
| ChallengerStructure=Flat, Backbone=DeepSeek-V32025.10 | 35 | 93.6 | |
| AttackStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 33.6 | 92.6 | |
| AttackStructure=Flat, Backbone=DeepSeek-V32025.10 | 33.4 | 87 | |
| AttackStructure=Flat, Model=GPT-4o2025.10 | 32 | 86.8 | |
| AttackStructure=Hierarchy, Model=GPT-4o2025.10 | 32 | 92.6 |