Access Control on Muses-Bench Deepseek (max-turns=10)
100PrivacyHarness-MU
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Harness-MUTemplate=colon, Attack=none, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 98.9 | 99.4 | |
| Harness-MUTemplate=colon, Attack=fake_authorized, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 97.2 | 98.1 | |
| Harness-MUTemplate=colon, Attack=pressure, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 100 | 100 | |
| Harness-MUTemplate=colon, Attack=roleplaying, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 97.8 | 98.8 | |
| Harness-MUTemplate=says, Attack=none, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 98.9 | 99.4 | |
| Harness-MUTemplate=says, Attack=fake_authorized, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 100 | 100 | |
| DeepseekTemplate=says, Attack=pressure, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 71 | 74.9 | |
| Harness-MUTemplate=says, Attack=pressure, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 100 | 100 | |
| Harness-MUTemplate=says, Attack=roleplaying, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 100 | 100 | |
| Harness-MUTemplate=xml, Attack=none, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 98.9 | 99.4 | |
| Harness-MUTemplate=xml, Attack=fake_authorized, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 100 | 100 | |
| Harness-MUTemplate=xml, Attack=pressure, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 96.1 | 97.5 | |
| Harness-MUTemplate=xml, Attack=roleplaying, Max Turns=10, Backbone=Deepseek2026.06 | 100 | 98.9 | 99.4 | |
| Harness-MUTemplate=MACRO (mean), Max Turns=10, Backbone=Deepseek2026.06 | 100 | 98.9 | 99.3 | |
| DeepseekTemplate=xml, Attack=fake_authorized, Max Turns=10, Backbone=Deepseek2026.06 | 98.6 | 70.5 | 73.5 | |
| DeepseekTemplate=xml, Attack=none, Max Turns=10, Backbone=Deepseek2026.06 | 97.2 | 59.5 | 60.8 | |
| DeepseekTemplate=says, Attack=roleplaying, Max Turns=10, Backbone=Deepseek2026.06 | 95.4 | 47.7 | 48.8 | |
| DeepseekTemplate=colon, Attack=pressure, Max Turns=10, Backbone=Deepseek2026.06 | 94.4 | 62.7 | 60.5 | |
| DeepseekTemplate=says, Attack=none, Max Turns=10, Backbone=Deepseek2026.06 | 94.4 | 56.2 | 55 | |
| DeepseekTemplate=xml, Attack=pressure, Max Turns=10, Backbone=Deepseek2026.06 | 94.4 | 48.1 | 44.2 | |
| DeepseekTemplate=colon, Attack=fake_authorized, Max Turns=10, Backbone=Deepseek2026.06 | 92.6 | 50.6 | 47.5 | |
| DeepseekTemplate=MACRO (mean), Max Turns=10, Backbone=Deepseek2026.06 | 92.6 | 59.7 | 56.6 | |
| DeepseekTemplate=xml, Attack=roleplaying, Max Turns=10, Backbone=Deepseek2026.06 | 91.7 | 60.1 | 56.9 | |
| DeepseekTemplate=colon, Attack=roleplaying, Max Turns=10, Backbone=Deepseek2026.06 | 85.6 | 70.1 | 62.1 | |
| DeepseekTemplate=says, Attack=fake_authorized, Max Turns=10, Backbone=Deepseek2026.06 | 84.7 | 59.4 | 49.3 | |
| DeepseekTemplate=colon, Attack=none, Max Turns=10, Backbone=Deepseek2026.06 | 81.5 | 60.7 | 45.6 |