General Language Understanding on 7-Task Evaluation Suite (test)
75.7Average AccuracyFP16
Evaluation Results
| Method | Links | |
|---|---|---|
| FP16Base Model=Qwen2.5-7B, Bits=16.02026.07 | 75.7 | |
| TASA b3.5Base Model=Qwen2.5-7B, Bits=3.5, Calibration Data (Calib)=Mixed2026.07 | 74.1 | |
| FP16Base Model=LLaMA-3-8B, Bits=16.02026.07 | 70.9 | |
| TASA b3.0Base Model=Qwen2.5-7B, Bits=3.0, Calibration Data (Calib)=Mixed2026.07 | 69.5 | |
| TASA b3.5Base Model=LLaMA-3-8B, Bits=3.5, Calibration Data (Calib)=Mixed2026.07 | 68.9 | |
| TASA b3.0Base Model=LLaMA-3-8B, Bits=3.0, Calibration Data (Calib)=Mixed2026.07 | 66.4 | |
| GPTQBase Model=Qwen2.5-7B, Bits=3.0, Calibration Data (Calib)=Wiki2026.07 | 66.1 | |
| TASA b2.5Base Model=Qwen2.5-7B, Bits=2.5, Calibration Data (Calib)=Mixed2026.07 | 57.5 | |
| TASA b2.5Base Model=LLaMA-3-8B, Bits=2.5, Calibration Data (Calib)=Mixed2026.07 | 54.7 | |
| GPTQBase Model=LLaMA-3-8B, Bits=3.0, Calibration Data (Calib)=Wiki2026.07 | 53.2 |