Answer Accuracy on ChatDoctor
40.8BRT AccuracyNo Attack
Evaluation results
| Method | Links | ||
|---|---|---|---|
| No AttackStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 40.8 | 98.4 | |
| BPDStructure=Flat, Model=GPT-4o2025.10 | 40.8 | 99.2 | |
| No AttackStructure=Flat, Backbone=DeepSeek-V32025.10 | 40.7 | 99.4 | |
| BPDStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 40.5 | 97.8 | |
| G-SafeguardStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 40.4 | 96.6 | |
| Single LLMStructure=Single LLM, Backbone=DeepSeek-V32025.10 | 40.3 | 97.6 | |
| BPDStructure=Flat, Backbone=DeepSeek-V32025.10 | 40.3 | 98.8 | |
| No AttackStructure=Hierarchy, Model=GPT-4o2025.10 | 40.2 | 98.6 | |
| G-SafeguardStructure=Hierarchy, Model=GPT-4o2025.10 | 40.1 | 96.8 | |
| Single LLMStructure=Single LLM, Model=GPT-4o2025.10 | 40 | 98 | |
| No AttackStructure=Flat, Model=GPT-4o2025.10 | 40 | 99.4 | |
| AGENTXPOSEDStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 39.3 | 95 | |
| BPDStructure=Hierarchy, Model=GPT-4o2025.10 | 39.2 | 98.4 | |
| G-SafeguardStructure=Flat, Model=GPT-4o2025.10 | 38.9 | 97 | |
| AGENTXPOSEDStructure=Hierarchy, Model=GPT-4o2025.10 | 38.9 | 95 | |
| G-SafeguardStructure=Flat, Backbone=DeepSeek-V32025.10 | 38.5 | 96.4 | |
| AGENTXPOSEDStructure=Flat, Backbone=DeepSeek-V32025.10 | 37.7 | 97.2 | |
| InspectorStructure=Flat, Backbone=DeepSeek-V32025.10 | 37.1 | 92.2 | |
| AGENTXPOSEDStructure=Flat, Model=GPT-4o2025.10 | 36.4 | 97.8 | |
| ChallengerStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 35.8 | 92.4 | |
| InspectorStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 35.8 | 93.4 | |
| ChallengerStructure=Flat, Backbone=DeepSeek-V32025.10 | 34.8 | 91.6 | |
| AttackStructure=Hierarchy, Backbone=DeepSeek-V32025.10 | 34.3 | 86.8 | |
| AttackStructure=Flat, Backbone=DeepSeek-V32025.10 | 33.9 | 86.2 | |
| AttackStructure=Flat, Model=GPT-4o2025.10 | 33.4 | 86.6 | |
| AttackStructure=Hierarchy, Model=GPT-4o2025.10 | 33.3 | 86.8 |