Safety Evaluation on MultiJail-AR (test)
89.101Safety Rate (%)AWQ-trust
Evaluation results
| Method | Links | |
|---|---|---|
| AWQ-trustBackbone=Llama-3.1-8B-Instruct, Quantization=AWQ-trust2026.01 | 89.101 | |
| AWQ-trustBackbone=Qwen-2.5-7B-Instruct, Quantization=AWQ-trust2026.01 | 89.101 | |
| Full PrecisionBackbone=Qwen-2.5-7B-Instruct, Quantization=Full Precision2026.01 | 81.376 | |
| AWQBackbone=Qwen-2.5-7B-Instruct, Quantization=AWQ2026.01 | 77.566 | |
| AWQ-trustBackbone=Gemma-7B-Instruct, Quantization=AWQ-trust2026.01 | 62.434 | |
| Full PrecisionBackbone=Gemma-7B-Instruct, Quantization=Full Precision2026.01 | 57.143 | |
| AWQBackbone=Gemma-7B-Instruct, Quantization=AWQ2026.01 | 55.979 | |
| Full PrecisionBackbone=Llama-3.1-8B-Instruct, Quantization=Full Precision2026.01 | 31.852 | |
| AWQBackbone=Llama-3.1-8B-Instruct, Quantization=AWQ2026.01 | 24.656 |