Misuse Evaluation on BSD Biology
88Decomp ScoreDecomposition Attack
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Decomposition AttackWeak (Unsafe) Model=Qwen2.5-72B, Strong Target Model=Gemini-2.5, Number of decompositions (n)=62025.06 | 88 | — | 20 | |
| Decomposition AttackWeak (Unsafe) Model=Qwen3-235B, Strong Target Model=Gemini-2.5, Number of decompositions (n)=62025.06 | 85 | — | 12 | |
| Decomposition AttackWeak (Unsafe) Model=Kimi K2-Instruct-0905, Strong Target Model=Gemini-2.5, Number of decompositions (n)=62025.06 | 83 | — | 33 | |
| Decomposition AttackWeak (Unsafe) Model=Llama-3.1-405B, Strong Target Model=Gemini-2.5, Number of decompositions (n)=62025.06 | 81 | — | 47 | |
| Decomposition AttackWeak (Unsafe) Model=Qwen2.5-72B, Strong Target Model=GPT-5, Number of decompositions (n)=62025.06 | 78 | — | 10 | |
| Decomposition AttackWeak (Unsafe) Model=Kimi K2-Instruct-0905, Strong Target Model=GPT-5, Number of decompositions (n)=62025.06 | 76 | — | 26 | |
| Decomposition AttackWeak (Unsafe) Model=Qwen3-235B, Strong Target Model=GPT-5, Number of decompositions (n)=62025.06 | 73 | — | 0 | |
| Decomposition AttackWeak (Unsafe) Model=Llama-3.1-405B, Strong Target Model=GPT-5, Number of decompositions (n)=62025.06 | 71 | — | 37 | |
| Direct QueryWeak (Unsafe) Model=Kimi K2-Instruct-09052025.06 | — | 50 | — | |
| Direct QueryWeak (Unsafe) Model=Qwen2.5-72B2025.06 | — | 68 | — | |
| Direct QueryWeak (Unsafe) Model=Qwen3-235B2025.06 | — | 73 | — | |
| Direct QueryWeak (Unsafe) Model=Llama-3.1-405B2025.06 | — | 34 | — |