Safe Reinforcement Learning on Safety-Gymnasium AntVelocity OSRL
0CostCPQ
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CPQAttack=Max Cost, Poison Ratio=5%, Unlearning Status=Before2026.06 | 0 | -3,000.1 | |
| CPQAttack=Max Cost, Poison Ratio=15%, Unlearning Status=Before2026.06 | 0 | -2,999.7 | |
| CPQAttack=Max Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 0 | -2,998.6 | |
| CPQAttack=Max Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 0 | -2,999.4 | |
| CPQAttack=Min Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 0 | -2,997.2 | |
| CPQAttack=Min Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 0 | -2,999 | |
| Safe-RULE (CPQ)Attack=Min Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 0 | 1,188.5 | |
| BEAR-LagAttack=Min Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 0 | -309.4 | |
| BEAR-LagAttack=Min Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 0 | -485.4 | |
| Safe-RULE (BEAR-Lag)Attack=Min Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 0 | 2,289.6 | |
| Safe-RULE (COptiDICE)Attack=Min Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 0 | 2,257.8 | |
| Safe-RULE (CPQ)Attack=Max Cost, Poison Ratio=15%, Unlearning Status=After2026.06 | 0.1 | 1,966.5 | |
| BEAR-LagAttack=Max Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 0.1 | 839.6 | |
| Safe-RULE (CPQ)Attack=Max Cost, Poison Ratio=5%, Unlearning Status=After2026.06 | 0.4 | 932.9 | |
| Safe-RULE (CPQ)Attack=Max Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 1.5 | 1,242.3 | |
| Safe-RULE (CPQ)Attack=Max Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 1.5 | 1,403.7 | |
| Safe-RULE (BEAR-Lag)Attack=Max Cost, Poison Ratio=15%, Unlearning Status=After2026.06 | 2.3 | 2,534.7 | |
| Safe-RULE (COptiDICE)Attack=Min Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 2.4 | 2,380 | |
| BCQ-LagAttack=Min Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 5.1 | 2,678.4 | |
| Safe-RULE (BEAR-Lag)Attack=Max Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 5.7 | 2,531.5 | |
| Safe-RULE (COptiDICE)Attack=Max Cost, Poison Ratio=15%, Unlearning Status=After2026.06 | 5.7 | 2,501.5 | |
| Safe-RULE (BEAR-Lag)Attack=Max Cost, Poison Ratio=5%, Unlearning Status=After2026.06 | 5.8 | 2,517.8 | |
| Safe-RULE (BEAR-Lag)Attack=Max Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 6.7 | 2,493 | |
| Safe-RULE (BCQ-Lag)Attack=Min Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 6.8 | 2,135.2 | |
| Safe-RULE (COptiDICE)Attack=Max Cost, Poison Ratio=5%, Unlearning Status=After2026.06 | 7.3 | 2,416 | |
| Safe-RULE (COptiDICE)Attack=Max Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 7.8 | 2,428.2 | |
| Safe-RULE (CPQ)Attack=Min Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 8.2 | 1,339.9 | |
| Safe-RULE (BEAR-Lag)Attack=Min Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 8.5 | 2,616.2 | |
| Safe-RULE (COptiDICE)Attack=Max Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 8.9 | 2,319.1 | |
| Safe-RULE (BCQ-Lag)Attack=Max Reward, Poison Ratio=15%, Unlearning Status=After2026.06 | 9.3 | 1,829.1 | |
| Safe-RULE (BCQ-Lag)Attack=Max Cost, Poison Ratio=15%, Unlearning Status=After2026.06 | 10.1 | 1,800.5 | |
| Safe-RULE (BCQ-Lag)Attack=Max Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 19.7 | 2,787.9 | |
| Safe-RULE (BCQ-Lag)Attack=Max Cost, Poison Ratio=5%, Unlearning Status=After2026.06 | 21.4 | 2,962 | |
| Safe-RULE (BCQ-Lag)Attack=Min Reward, Poison Ratio=5%, Unlearning Status=After2026.06 | 36.2 | 2,570.8 | |
| COptiDICEAttack=Max Cost, Poison Ratio=15%, Unlearning Status=Before2026.06 | 39.8 | 1,260.6 | |
| COptiDICEAttack=Min Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 43.9 | 851.9 | |
| COptiDICEAttack=Max Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 46.1 | 1,533.1 | |
| BCQ-LagAttack=Max Cost, Poison Ratio=5%, Unlearning Status=Before2026.06 | 50.8 | 2,984.9 | |
| BEAR-LagAttack=Max Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 60.5 | 2,660.2 | |
| BCQ-LagAttack=Max Cost, Poison Ratio=15%, Unlearning Status=Before2026.06 | 74.2 | 2,898.4 | |
| BCQ-LagAttack=Max Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 89 | 3,018.9 | |
| COptiDICEAttack=Max Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 90.2 | 2,942.6 | |
| BCQ-LagAttack=Max Reward, Poison Ratio=15%, Unlearning Status=Before2026.06 | 94.8 | 2,603.1 | |
| BEAR-LagAttack=Max Cost, Poison Ratio=5%, Unlearning Status=Before2026.06 | 101.3 | 544.4 | |
| COptiDICEAttack=Max Cost, Poison Ratio=5%, Unlearning Status=Before2026.06 | 108 | 2,941.9 | |
| BCQ-LagAttack=Min Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 123.9 | 2,781.7 | |
| COptiDICEAttack=Min Reward, Poison Ratio=5%, Unlearning Status=Before2026.06 | 140.2 | 2,997.3 | |
| BEAR-LagAttack=Max Cost, Poison Ratio=15%, Unlearning Status=Before2026.06 | 520.3 | 2,738.2 |