# Misalignment Detection on Agent-SafetyBench n=35 (aligned traces) Source: [Misalignment Detection on Agent-SafetyBench n=35 (aligned traces)]() Collection index: [llms.txt]() Data updated: 2026-07-03T06:22:16.366Z Evaluation of model performance on detecting misalignment using the specific subset of 35 aligned traces from the Agent-SafetyBench dataset, reporting Avg. IR, Delta (mean difference), and p-value. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Misalignment Detection | | Dataset (including any stated split) | Agent-SafetyBench n=35 (aligned traces) | | Metric | Avg. IR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Avg. IR](): Higher is better; unit: PERCENT. - [Delta (Mean Difference)](): Lower is better; unit: SCALAR. - [p-value](): Lower is better; unit: PERCENT. ## Recorded results | Method | Avg. IR | Result date | Report paper | | --- | --- | --- | --- | | DirectPrompt | 31.4 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvePrompt | 31.4 | Not recorded | 6a4741ee143ebdcacacc5a79 | | DirectPrompt | 25.7 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvenanceGuard | 18.9 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvenanceGuard | 17.7 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvePrompt | 17.7 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvenanceGuard | 17.1 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvenanceGuard | 17.1 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvenanceGuard | 17.1 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvenanceGuard | 13.7 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvePrompt | 13.7 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvenanceGuard | 10.9 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvenanceGuard | 10.9 | Not recorded | 6a4741ee143ebdcacacc5a79 | | DirectPrompt | 9.7 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvePrompt | 9.7 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvenanceGuard | 9.1 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvePrompt | 8.6 | Not recorded | 6a4741ee143ebdcacacc5a79 | | DirectPrompt | 8.6 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvenanceGuard | 6.9 | Not recorded | 6a4741ee143ebdcacacc5a79 | | DirectPrompt | 6.3 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvePrompt | 6.3 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvePrompt | 5.7 | Not recorded | 6a4741ee143ebdcacacc5a79 | | DirectPrompt | 5.7 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvePrompt | 4.6 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvePrompt | 4.6 | Not recorded | 6a4741ee143ebdcacacc5a79 | | DirectPrompt | 4 | Not recorded | 6a4741ee143ebdcacacc5a79 | | DirectPrompt | 2.9 | Not recorded | 6a4741ee143ebdcacacc5a79 | | DirectPrompt | 2.9 | Not recorded | 6a4741ee143ebdcacacc5a79 | | DirectPrompt | 1.1 | Not recorded | 6a4741ee143ebdcacacc5a79 | | ProvePrompt | 1.1 | Not recorded | 6a4741ee143ebdcacacc5a79 | ### DirectPrompt Avg. IR: 31.4. Result ID: 6a4754fa60b88bb33991b2aa. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemini 2.5 Flash-Lite"}. This record does not assert independent reproduction. ### ProvePrompt Avg. IR: 31.4. Result ID: 6a4754fa60b88bb33991b2af. [Reporting paper]() Recorded evaluation configuration: {"Model":"Claude Haiku 4.5"}. This record does not assert independent reproduction. ### DirectPrompt Avg. IR: 25.7. Result ID: 6a4754fa60b88bb33991b2b0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Claude Haiku 4.5"}. This record does not assert independent reproduction. ### ProvenanceGuard Avg. IR: 18.9. Result ID: 6a4754fa60b88bb33991b2a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini 2.5 Flash-Lite"}. This record does not assert independent reproduction. ### ProvenanceGuard Avg. IR: 17.7. Result ID: 6a4754fa60b88bb33991b29c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4.1 Mini"}. This record does not assert independent reproduction. ### ProvePrompt Avg. IR: 17.7. Result ID: 6a4754fa60b88bb33991b2a6. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemini 2.5 Flash"}. This record does not assert independent reproduction. ### ProvenanceGuard Avg. IR: 17.1. Result ID: 6a4754fa60b88bb33991b29f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini 3 Flash"}. This record does not assert independent reproduction. ### ProvenanceGuard Avg. IR: 17.1. Result ID: 6a4754fa60b88bb33991b2a2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini 3.1 Flash-Lite"}. This record does not assert independent reproduction. ### ProvenanceGuard Avg. IR: 17.1. Result ID: 6a4754fa60b88bb33991b2ae. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Claude Haiku 4.5"}. This record does not assert independent reproduction. ### ProvenanceGuard Avg. IR: 13.7. Result ID: 6a4754fa60b88bb33991b299. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-4.1"}. This record does not assert independent reproduction. ### ProvePrompt Avg. IR: 13.7. Result ID: 6a4754fa60b88bb33991b2a9. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemini 2.5 Flash-Lite"}. This record does not assert independent reproduction. ### ProvenanceGuard Avg. IR: 10.9. Result ID: 6a4754fa60b88bb33991b296. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-5 Mini"}. This record does not assert independent reproduction. ### ProvenanceGuard Avg. IR: 10.9. Result ID: 6a4754fa60b88bb33991b2ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Claude Sonnet 4.6"}. This record does not assert independent reproduction. ### DirectPrompt Avg. IR: 9.7. Result ID: 6a4754fa60b88bb33991b29e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT-4.1 Mini"}. This record does not assert independent reproduction. ### ProvePrompt Avg. IR: 9.7. Result ID: 6a4754fa60b88bb33991b2a0. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemini 3 Flash"}. This record does not assert independent reproduction. ### ProvenanceGuard Avg. IR: 9.1. Result ID: 6a4754fa60b88bb33991b2a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini 2.5 Flash"}. This record does not assert independent reproduction. ### ProvePrompt Avg. IR: 8.6. Result ID: 6a4754fa60b88bb33991b2a3. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemini 3.1 Flash-Lite"}. This record does not assert independent reproduction. ### DirectPrompt Avg. IR: 8.6. Result ID: 6a4754fa60b88bb33991b2a7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemini 2.5 Flash"}. This record does not assert independent reproduction. ### ProvenanceGuard Avg. IR: 6.9. Result ID: 6a4754fa60b88bb33991b293. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-5"}. This record does not assert independent reproduction. ### DirectPrompt Avg. IR: 6.3. Result ID: 6a4754fa60b88bb33991b29b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT-4.1"}. This record does not assert independent reproduction. ### ProvePrompt Avg. IR: 6.3. Result ID: 6a4754fa60b88bb33991b2ac. [Reporting paper]() Recorded evaluation configuration: {"Model":"Claude Sonnet 4.6"}. This record does not assert independent reproduction. ### ProvePrompt Avg. IR: 5.7. Result ID: 6a4754fa60b88bb33991b29a. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4.1"}. This record does not assert independent reproduction. ### DirectPrompt Avg. IR: 5.7. Result ID: 6a4754fa60b88bb33991b2a4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemini 3.1 Flash-Lite"}. This record does not assert independent reproduction. ### ProvePrompt Avg. IR: 4.6. Result ID: 6a4754fa60b88bb33991b294. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-5"}. This record does not assert independent reproduction. ### ProvePrompt Avg. IR: 4.6. Result ID: 6a4754fa60b88bb33991b29d. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-4.1 Mini"}. This record does not assert independent reproduction. ### DirectPrompt Avg. IR: 4. Result ID: 6a4754fa60b88bb33991b2a1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemini 3 Flash"}. This record does not assert independent reproduction. ### DirectPrompt Avg. IR: 2.9. Result ID: 6a4754fa60b88bb33991b298. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT-5 Mini"}. This record does not assert independent reproduction. ### DirectPrompt Avg. IR: 2.9. Result ID: 6a4754fa60b88bb33991b2ad. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Claude Sonnet 4.6"}. This record does not assert independent reproduction. ### DirectPrompt Avg. IR: 1.1. Result ID: 6a4754fa60b88bb33991b295. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT-5"}. This record does not assert independent reproduction. ### ProvePrompt Avg. IR: 1.1. Result ID: 6a4754fa60b88bb33991b297. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-5 Mini"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.