Harmful Compliance Prediction on Locked GLM (test)
1.489BetaLlama-3.1-8B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Llama-3.1-8BReference Model=OLMo-3-Instruct, Frame Reference=deployment, Interaction term=model × evaluation2026.05 | 1.489 | 0.599 | 2.49 | 0.013 | |
| Phi-3.5-miniReference Model=OLMo-3-Instruct, Frame Reference=deployment, Interaction term=model × evaluation2026.05 | 1.25 | 0.452 | 2.77 | 0.006 | |
| Mistral-Small-3.2Reference Model=OLMo-3-Instruct, Frame Reference=deployment, Interaction term=model × evaluation2026.05 | 1.246 | 0.494 | 2.52 | 0.012 | |
| Llama-3.1-70BReference Model=OLMo-3-Instruct, Frame Reference=deployment, Interaction term=model × evaluation2026.05 | 0.735 | 0.541 | 1.36 | 0.174 |