Language Modeling on Gemma 3
47.06AccuracyBaseline
Evaluation results
| Method | Links | |
|---|---|---|
| BaselineModel=Gemma3 4B, Act Bits (A)=16, Weight Bits (W)=16, SCQ=-, Sparsity=None2024.09 | 47.06 | |
| LinearModel=Gemma3 4B, Act Bits (A)=4, Weight Bits (W)=1, SCQ=128, Sparsity=2:42024.09 | 45.17 | |
| AffineModel=Gemma3 4B, Act Bits (A)=4, Weight Bits (W)=1, SCQ=128, Sparsity=None2024.09 | 45.1 | |
| LinearModel=Gemma3 4B, Act Bits (A)=4, Weight Bits (W)=1, SCQ=128, Sparsity=None2024.09 | 44.96 | |
| BaselineModel=Gemma3 1B, Act Bits (A)=16, Weight Bits (W)=16, SCQ=-, Sparsity=None2024.09 | 44.94 | |
| AffineModel=Gemma3 4B, Act Bits (A)=2, Weight Bits (W)=2, SCQ=128, Sparsity=None2024.09 | 44.65 | |
| AffineModel=Gemma3 1B, Act Bits (A)=4, Weight Bits (W)=4, SCQ=128, Sparsity=None2024.09 | 44.43 | |
| LinearModel=Gemma3 4B, Act Bits (A)=1.5, Weight Bits (W)=1.5, SCQ=32, Sparsity=None2024.09 | 43.93 | |
| LinearModel=Gemma3 4B, Act Bits (A)=1.5, Weight Bits (W)=1.5, SCQ=128, Sparsity=None2024.09 | 42.98 | |
| AffineModel=Gemma3 4B, Act Bits (A)=1, Weight Bits (W)=1, SCQ=128, Sparsity=None2024.09 | 42.21 |