Safe Agent Planning on SafeAgentBench 1.0 (test)
0Harm Rate (HAR)Thinker
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ThinkerKnowledge Access=+ Diagnostic2026.02 | 0 | 76.8 | 10.1 | 14.4 | — | 10.2 | |
| VIRF-RejectVariant=Ablation2026.02 | 0 | 63.4 | 15.9 | 33 | 1.3 | 40.5 | |
| VIRFVariant=Full2026.02 | 0 | 77.3 | 12.1 | 20.2 | 1.1 | 25.5 | |
| ImpulsiveKnowledge Access=+ Rules2026.02 | 0.9 | 70.5 | 13.3 | 21.4 | — | 15.5 | |
| VIRF-ManualVariant=Ablation2026.02 | 1 | 70.4 | 19.5 | 23.7 | 1.1 | 24.9 | |
| ThinkerKnowledge Access=+ Rules2026.02 | 1.2 | 67 | 12.4 | 22.7 | — | 11 | |
| CommitteeBaseline Style=SAFER-like2026.02 | 7.6 | 57.3 | 28.6 | 18.9 | 1.98 | 71.1 | |
| ThinkerReasoning=Chain-of-Thought2026.02 | 9.8 | 59.1 | 35.4 | 14.4 | — | 17.1 | |
| VIRF-RAGVariant=Ablation2026.02 | 11 | 57.8 | 31.9 | 15.5 | 1 | 30.4 | |
| ImpulsiveReasoning=Direct2026.02 | 11.9 | 56.8 | 32.7 | 16.5 | — | 15.2 |