Safety Evaluation on SafetyBench
69.4SafetyFine-tuned
Evaluation Results
| Method | Links | |
|---|---|---|
| Fine-tunedModel Backbone=Qwen2-7B, Precision=FP162025.11 | 69.4 | |
| CAQModel Backbone=Qwen2-7B, Precision=W4A42025.11 | 66.8 | |
| OSTQuantModel Backbone=Qwen2-7B, Precision=W4A42025.11 | 66.5 | |
| SpinQuantModel Backbone=Qwen2-7B, Precision=W4A42025.11 | 65.6 | |
| QuaRotModel Backbone=Qwen2-7B, Precision=W4A42025.11 | 65.2 | |
| Fine-tunedModel Backbone=LLaMA3.1-8B, Precision=FP162025.11 | 62.6 | |
| Pre-trainedModel Backbone=Qwen2-7B, Precision=FP162025.11 | 61.9 | |
| CAQModel Backbone=LLaMA3.1-8B, Precision=W4A42025.11 | 60.1 | |
| OSTQuantModel Backbone=LLaMA3.1-8B, Precision=W4A42025.11 | 57.5 | |
| SpinQuantModel Backbone=LLaMA3.1-8B, Precision=W4A42025.11 | 54.9 | |
| QuaRotModel Backbone=LLaMA3.1-8B, Precision=W4A42025.11 | 54.8 | |
| DuQuantModel Backbone=LLaMA3.1-8B, Precision=W4A42025.11 | 51.6 | |
| Pre-trainedModel Backbone=LLaMA3.1-8B, Precision=FP162025.11 | 50.3 | |
| Fine-tunedModel Backbone=LLaMA2-7B, Precision=FP162025.11 | 50 | |
| CAQModel Backbone=LLaMA2-7B, Precision=W4A42025.11 | 49.7 | |
| OSTQuantModel Backbone=LLaMA2-7B, Precision=W4A42025.11 | 48.9 | |
| SpinQuantModel Backbone=LLaMA2-7B, Precision=W4A42025.11 | 48.2 | |
| QuaRotModel Backbone=LLaMA2-7B, Precision=W4A42025.11 | 47.1 | |
| DuQuantModel Backbone=LLaMA2-7B, Precision=W4A42025.11 | 46.5 | |
| Pre-trainedModel Backbone=LLaMA2-7B, Precision=FP162025.11 | 42.7 | |
| RTNModel Backbone=LLaMA3.1-8B, Precision=W4A42025.11 | 37.5 | |
| GPTQModel Backbone=Qwen2-7B, Precision=W4A42025.11 | 36.9 | |
| GPTQModel Backbone=LLaMA3.1-8B, Precision=W4A42025.11 | 36.6 | |
| RTNModel Backbone=Qwen2-7B, Precision=W4A42025.11 | 36.5 | |
| RTNModel Backbone=LLaMA2-7B, Precision=W4A42025.11 | 35.9 | |
| GPTQModel Backbone=LLaMA2-7B, Precision=W4A42025.11 | 35.7 |