Sabotage Detection on SHADE-Arena Jira Tickets
72.5AccuracySequential
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SequentialMonitor backbone=Claude Sonnet 4.62026.06 | 72.5 | 100 | 48.1 | 65 | |
| Full-trajectoryMonitor backbone=Claude Sonnet 4.62026.06 | 58.8 | 100 | 22.2 | 36.4 | |
| TRACEMonitor backbone=Claude Sonnet 4.62026.06 | 52.9 | 54.3 | 70.4 | 61.3 |