Sabotage Detection on SHADE-Arena API Key Calendar
88.5AccuracyFull-trajectory
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Full-trajectoryMonitor backbone=Claude Sonnet 4.62026.06 | 88.5 | 100 | 78.1 | 87.7 | |
| SequentialMonitor backbone=Claude Sonnet 4.62026.06 | 65.6 | 82.4 | 43.8 | 57.1 | |
| TRACEMonitor backbone=Claude Sonnet 4.62026.06 | 57.4 | 55.4 | 96.9 | 70.5 |