Fairness Evaluation on Jigsaw
75.6BiasAUCAWQ-trust
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| AWQ-trustModel=Qwen-2.5-7B-Instruct, Quantization=AWQ-trust2026.01 | 75.6 | 75.8 | |
| AWQ-trustModel=Llama-3.1-8B-Instruct, Quantization=AWQ-trust2026.01 | 74.3 | 74.5 | |
| Full PrecisionModel=Qwen-2.5-7B-Instruct, Quantization=Full Precision2026.01 | 74.2 | 74.4 | |
| AWQModel=Qwen-2.5-7B-Instruct, Quantization=AWQ2026.01 | 74.1 | 74.4 | |
| Full PrecisionModel=Llama-3.1-8B-Instruct, Quantization=Full Precision2026.01 | 73.9 | 74.1 | |
| AWQModel=Llama-3.1-8B-Instruct, Quantization=AWQ2026.01 | 73.2 | 73.4 | |
| Full PrecisionModel=Gemma-7B-Instruct, Quantization=Full Precision2026.01 | 48.7 | 49 | |
| AWQ-trustModel=Gemma-7B-Instruct, Quantization=AWQ-trust2026.01 | 47.7 | 48.1 | |
| AWQModel=Gemma-7B-Instruct, Quantization=AWQ2026.01 | 41.2 | 41.7 |