Safe Reinforcement Learning on Safety-Gymnasium PointGoal OSRL
2.3CostSafe-RULE (COptiDICE)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Safe-RULE (COptiDICE)Attack=Min Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 2.3 | 1.6 | |
| Safe-RULE (CPQ)Attack=Max Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 3.5 | 7.9 | |
| Safe-RULE (CPQ)Attack=Max Cost, Poison Ratio=5%, Unlearning Status=After2026.06 | 4.7 | 12.6 | |
| CPQAttack=Max Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 4.9 | -2.1 | |
| Safe-RULE (BEAR-Lag)Attack=Min Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 4.9 | 12.1 | |
| Safe-RULE (CPQ)Attack=Min Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 5.3 | 0.5 | |
| BEAR-LagAttack=Min Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 6.8 | -26.8 | |
| Safe-RULE (CPQ)Attack=Max Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 7.2 | 0.7 | |
| Safe-RULE (BEAR-Lag)Attack=Min Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 7.3 | 8.4 | |
| Safe-RULE (BEAR-Lag)Attack=Max Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 8.1 | 4.9 | |
| Safe-RULE (BEAR-Lag)Attack=Max Cost, Poison Ratio=5%, Unlearning Status=After2026.06 | 8.9 | 9.5 | |
| Safe-RULE (BCQ-Lag)Attack=Min Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 9.4 | 9.1 | |
| Safe-RULE (CPQ)Attack=Min Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 9.4 | 14.4 | |
| Safe-RULE (BEAR-Lag)Attack=Max Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 10.1 | 12.3 | |
| Safe-RULE (COptiDICE)Attack=Max Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 10.3 | 5.9 | |
| Safe-RULE (BEAR-Lag)Attack=Max Cost, Poison Ratio=15%, Unlearning Status=After2026.06 | 10.4 | 9.1 | |
| Safe-RULE (COptiDICE)Attack=Min Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 10.4 | 4.9 | |
| Safe-RULE (BCQ-Lag)Attack=Min Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 10.8 | 10.8 | |
| Safe-RULE (COptiDICE)Attack=Max Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 14.9 | 7.8 | |
| Safe-RULE (COptiDICE)Attack=Max Cost, Poison Ratio=5%, Unlearning Status=After2026.06 | 17.1 | 12.7 | |
| Safe-RULE (BCQ-Lag)Attack=Max Cost, Poison Ratio=5%, Unlearning Status=After2026.06 | 17.5 | 18.3 | |
| BCQ-LagAttack=Min Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 18.9 | 2.8 | |
| Safe-RULE (BCQ-Lag)Attack=Max Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 21.9 | 19.5 | |
| Safe-RULE (CPQ)Attack=Max Cost, Poison Ratio=15%, Unlearning Status=After2026.06 | 21.9 | 0.1 | |
| Safe-RULE (COptiDICE)Attack=Max Cost, Poison Ratio=15%, Unlearning Status=After2026.06 | 22.7 | 8.7 | |
| Safe-RULE (BCQ-Lag)Attack=Max Cost, Poison Ratio=15%, Unlearning Status=After2026.06 | 23.9 | 14.6 | |
| Safe-RULE (BCQ-Lag)Attack=Max Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 24.2 | 17.4 | |
| BEAR-LagAttack=Min Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 27.9 | 10.5 | |
| BCQ-LagAttack=Max Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 30.6 | 19.1 | |
| BEAR-LagAttack=Max Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 30.8 | 6.3 | |
| BCQ-LagAttack=Max Cost, Poison Ratio=5%, Unlearning Status=Before2026.06 | 31.1 | 13.9 | |
| CPQAttack=Max Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 32 | -0.7 | |
| BCQ-LagAttack=Max Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 32.6 | 21.4 | |
| BCQ-LagAttack=Min Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 33.6 | 13.6 | |
| COptiDICEAttack=Min Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 36.6 | -9.1 | |
| CPQAttack=Max Cost, Poison Ratio=5%, Unlearning Status=Before2026.06 | 42.1 | 0.1 | |
| CPQAttack=Max Cost, Poison Ratio=15%, Unlearning Status=Before2026.06 | 42.1 | 0.1 | |
| COptiDICEAttack=Max Cost, Poison Ratio=15%, Unlearning Status=Before2026.06 | 45.3 | 16.7 | |
| COptiDICEAttack=Min Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 46.4 | 9 | |
| CPQAttack=Min Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 52.9 | -1.9 | |
| CPQAttack=Min Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 54.6 | 0.3 | |
| COptiDICEAttack=Max Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 60.6 | 15.6 | |
| COptiDICEAttack=Max Cost, Poison Ratio=5%, Unlearning Status=Before2026.06 | 64.3 | 14.2 | |
| BCQ-LagAttack=Max Cost, Poison Ratio=15%, Unlearning Status=Before2026.06 | 69 | 15.8 | |
| BEAR-LagAttack=Max Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 69.8 | -0.6 | |
| COptiDICEAttack=Max Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 70.3 | 13 | |
| BEAR-LagAttack=Max Cost, Poison Ratio=5%, Unlearning Status=Before2026.06 | 208 | 0 | |
| BEAR-LagAttack=Max Cost, Poison Ratio=15%, Unlearning Status=Before2026.06 | 262.1 | 1 |