Safety and Utility Evaluation on FINVAULT
50.5Approve RateB5 LF-A
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| B5 LF-Amapping=advisory, base_method=LlamaFirewall2026.05 | 50.5 | 40.2 | 10.3 | |
| FH-postmode=observation-aware post-execution variant2026.05 | 46.7 | 19.6 | 27.1 | |
| B02026.05 | 41.1 | 38.3 | 2.8 | |
| FH-routedmode=cost-aware pre-execution2026.05 | 39.3 | 15 | 24.3 | |
| B12026.05 | 38.3 | 28 | 10.3 | |
| FH-AAmode=always-advanced ablation2026.05 | 37.4 | 8.4 | 29 | |
| B32026.05 | 36.4 | 17.8 | 18.6 | |
| B42026.05 | 36.4 | 20.6 | 15.8 | |
| B22026.05 | 35.5 | 26.2 | 9.3 | |
| B5 LF-S†mapping=strict / fail-closed, base_method=LlamaFirewall2026.05 | 26.2 | 5.6 | 20.6 | |
| B6 GA2026.05 | 8.4 | 2.8 | 5.6 | |
| B7 IA2026.05 | 8.4 | 0.9 | 7.5 |