Zero-shot Evaluation on Zero-shot Evaluation Suite Aggregate
73Average Accuracy (Zero-shot)AWQ
Evaluation Results
| Method | Links | |
|---|---|---|
| AWQModel=Mixtral-8x7B, Avg bitwidth=3.252025.11 | 73 | |
| PuzzleMoEModel=Mixtral-8x7B, Avg bitwidth=3.352025.11 | 72.4 | |
| NAEE+AWQModel=Mixtral-8x7B, Avg bitwidth=3.192025.11 | 70.1 | |
| HC-SMoE+AWQModel=Mixtral-8x7B, Avg bitwidth=3.302025.11 | 70.1 | |
| PuzzleMoEModel=Deepseek-MoE, Avg bitwidth=3.352025.11 | 61.6 | |
| AWQModel=Deepseek-MoE, Avg bitwidth=3.252025.11 | 61.2 | |
| HC-SMoE+AWQModel=Deepseek-MoE, Avg bitwidth=3.302025.11 | 53.3 |