Safety Evaluation on MultiJail EN (test)
93.651Safety RateAWQ
Evaluation results
| Method | Links | |
|---|---|---|
| AWQBackbone=Gemma-7B-Instruct, Quantization=AWQ2026.01 | 93.651 | |
| Full PrecisionBackbone=Gemma-7B-Instruct, Quantization=Full Precision2026.01 | 92.91 | |
| AWQ-trustBackbone=Gemma-7B-Instruct, Quantization=AWQ-trust2026.01 | 92.487 | |
| AWQ-trustBackbone=Llama-3.1-8B-Instruct, Quantization=AWQ-trust2026.01 | 90.265 | |
| AWQ-trustBackbone=Qwen-2.5-7B-Instruct, Quantization=AWQ-trust2026.01 | 88.571 | |
| AWQBackbone=Qwen-2.5-7B-Instruct, Quantization=AWQ2026.01 | 87.725 | |
| Full PrecisionBackbone=Qwen-2.5-7B-Instruct, Quantization=Full Precision2026.01 | 87.09 | |
| Full PrecisionBackbone=Llama-3.1-8B-Instruct, Quantization=Full Precision2026.01 | 83.28 | |
| AWQBackbone=Llama-3.1-8B-Instruct, Quantization=AWQ2026.01 | 80.635 |