Harmful Knowledge Evaluation on WMDP evil
65.37WMDP-evil ScoreBase
Evaluation Results
| Method | Links | |
|---|---|---|
| BaseModel=Qwen2.5-7B-Instruct, Harmful-RL attack=GRPO2025.08 | 65.37 | |
| BaseModel=Qwen2.5-7B-Instruct, Harmful-RL attack=RLOO2025.08 | 64.79 | |
| RepNoiseModel=Qwen2.5-7B-Instruct, Harmful-RL attack=REIN++2025.08 | 64.6 | |
| BaseModel=Qwen2.5-7B-Instruct, Harmful-RL attack=REIN++2025.08 | 64.53 | |
| RepNoiseModel=Qwen2.5-7B-Instruct, Harmful-RL attack=RLOO2025.08 | 64.47 | |
| BaseModel=Qwen2.5-7B-Instruct, Harmful-RL attack=PPO2025.08 | 63.43 | |
| RepNoiseModel=Qwen2.5-7B-Instruct, Harmful-RL attack=GRPO2025.08 | 62.33 | |
| RepNoiseModel=Qwen2.5-7B-Instruct, Harmful-RL attack=PPO2025.08 | 59.03 | |
| CTRAPModel=Qwen2.5-7B-Instruct, Harmful-RL attack=PPO2025.08 | 54.24 | |
| CTRAPModel=Qwen2.5-7B-Instruct, Harmful-RL attack=GRPO2025.08 | 53.4 | |
| BaseModel=Qwen2.5-3B-Instruct, Harmful-RL attack=RLOO2025.08 | 51.52 | |
| BaseModel=Qwen2.5-3B-Instruct, Harmful-RL attack=REIN++2025.08 | 51.2 | |
| BaseModel=Qwen2.5-3B-Instruct, Harmful-RL attack=PPO2025.08 | 50.68 | |
| BaseModel=Ministral-8B-Instruct, Harmful-RL attack=GRPO2025.08 | 50.23 | |
| BaseModel=Ministral-8B-Instruct, Harmful-RL attack=PPO2025.08 | 50.16 | |
| RepNoiseModel=Ministral-8B-Instruct, Harmful-RL attack=RLOO2025.08 | 50.03 | |
| BaseModel=Qwen2.5-3B-Instruct, Harmful-RL attack=GRPO2025.08 | 49.97 | |
| CTRAPModel=Qwen2.5-7B-Instruct, Harmful-RL attack=RLOO2025.08 | 47.12 | |
| CTRAPModel=Qwen2.5-7B-Instruct, Harmful-RL attack=REIN++2025.08 | 45.18 | |
| BaseModel=Ministral-8B-Instruct, Harmful-RL attack=RLOO2025.08 | 44.4 | |
| RepNoiseModel=Qwen2.5-3B-Instruct, Harmful-RL attack=REIN++2025.08 | 43.95 | |
| RepNoiseModel=Qwen2.5-3B-Instruct, Harmful-RL attack=PPO2025.08 | 43.75 | |
| RepNoiseModel=Ministral-8B-Instruct, Harmful-RL attack=GRPO2025.08 | 43.75 | |
| RepNoiseModel=Ministral-8B-Instruct, Harmful-RL attack=PPO2025.08 | 42.59 | |
| BaseModel=Ministral-8B-Instruct, Harmful-RL attack=REIN++2025.08 | 41.29 | |
| RepNoiseModel=Qwen2.5-3B-Instruct, Harmful-RL attack=GRPO2025.08 | 41.1 | |
| CTRAPModel=Qwen2.5-3B-Instruct, Harmful-RL attack=REIN++2025.08 | 40.97 | |
| RepNoiseModel=Ministral-8B-Instruct, Harmful-RL attack=REIN++2025.08 | 39.81 | |
| RepNoiseModel=Qwen2.5-3B-Instruct, Harmful-RL attack=RLOO2025.08 | 39.22 | |
| CTRAPModel=Qwen2.5-3B-Instruct, Harmful-RL attack=GRPO2025.08 | 38.06 | |
| CTRAPModel=Ministral-8B-Instruct, Harmful-RL attack=PPO2025.08 | 38.06 | |
| CTRAPModel=Ministral-8B-Instruct, Harmful-RL attack=REIN++2025.08 | 36.38 | |
| CTRAPModel=Qwen2.5-3B-Instruct, Harmful-RL attack=PPO2025.08 | 35.99 | |
| CTRAPModel=Ministral-8B-Instruct, Harmful-RL attack=GRPO2025.08 | 35.86 | |
| CTRAPModel=Ministral-8B-Instruct, Harmful-RL attack=RLOO2025.08 | 35.08 | |
| CTRAPModel=Qwen2.5-3B-Instruct, Harmful-RL attack=RLOO2025.08 | 34.82 | |
| RepNoiseModel=Ministral-8B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 18.45 | |
| CTRAPModel=Ministral-8B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 17.09 | |
| BaseModel=Qwen2.5-3B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 16.5 | |
| BaseModel=Qwen2.5-7B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 14.95 | |
| BaseModel=Ministral-8B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 14.56 | |
| RepNoiseModel=Qwen2.5-3B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 13.01 | |
| TokenBuncherModel=Ministral-8B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 11.52 | |
| RepNoiseModel=Qwen2.5-7B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 11 | |
| TokenBuncherModel=Ministral-8B-Instruct, Harmful-RL attack=REIN++2025.08 | 10.74 | |
| CTRAPModel=Qwen2.5-3B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 10.49 | |
| TokenBuncherModel=Ministral-8B-Instruct, Harmful-RL attack=RLOO2025.08 | 10.29 | |
| TokenBuncherModel=Qwen2.5-3B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 10.23 | |
| TokenBuncherModel=Qwen2.5-3B-Instruct, Harmful-RL attack=REIN++2025.08 | 9.32 | |
| TokenBuncherModel=Qwen2.5-3B-Instruct, Harmful-RL attack=GRPO2025.08 | 8.54 | |
| TokenBuncherModel=Qwen2.5-7B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 8.09 | |
| TokenBuncherModel=Qwen2.5-7B-Instruct, Harmful-RL attack=GRPO2025.08 | 7.96 | |
| TokenBuncherModel=Qwen2.5-7B-Instruct, Harmful-RL attack=RLOO2025.08 | 7.83 | |
| TokenBuncherModel=Qwen2.5-7B-Instruct, Harmful-RL attack=REIN++2025.08 | 7.77 | |
| TokenBuncherModel=Ministral-8B-Instruct, Harmful-RL attack=GRPO2025.08 | 7.77 | |
| TokenBuncherModel=Qwen2.5-3B-Instruct, Harmful-RL attack=RLOO2025.08 | 7.7 | |
| CTRAPModel=Qwen2.5-7B-Instruct, Harmful-RL attack=w/o-attack2025.08 | 7.51 | |
| TokenBuncherModel=Ministral-8B-Instruct, Harmful-RL attack=PPO2025.08 | 5.44 | |
| TokenBuncherModel=Qwen2.5-7B-Instruct, Harmful-RL attack=PPO2025.08 | 4.27 | |
| TokenBuncherModel=Qwen2.5-3B-Instruct, Harmful-RL attack=PPO2025.08 | 3.43 |