Sabotage detection on SHADE-Arena
78log-AUROCCoT+action
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CoT+actionMonitor Model=GPT-4.12026.01 | 78 | — | |
| CoT-onlyMonitor Model=Claude-3.5-Haiku2026.01 | 63 | — | |
| CoT-onlyMonitor Model=GPT-4.12026.01 | 57 | — | |
| Extract-and-EvaluateMonitor Model=GPT-4.12026.01 | 52 | — | |
| Action-onlyMonitor Model=GPT-4.12026.01 | 44 | — | |
| CoT+actionMonitor Model=Claude-3.5-Haiku2026.01 | 37 | — | |
| Extract-and-EvaluateMonitor Model=Claude-3.5-Haiku2026.01 | 31 | — | |
| Action-onlyMonitor Model=Claude-3.5-Haiku2026.01 | 27 | — |