Language Model Evaluation on Aggregate
69.86Average ScoreFP
Evaluation results
| Method | Links | |
|---|---|---|
| FPBackbone=LLADA-1.5-8B, Weight Bits=Full Precision, Activation Bits=Full Precision2026.06 | 69.86 | |
| FPBackbone=DREAM-7B, Weight Bits=Full Precision, Activation Bits=Full Precision2026.06 | 66.94 | |
| STaR-QuantBackbone=LLADA-1.5-8B, Weight Bits=4, Activation Bits=42026.06 | 66.93 | |
| DLLMQuant++Backbone=LLADA-1.5-8B, Weight Bits=4, Activation Bits=42026.06 | 64.31 | |
| STaR-QuantBackbone=DREAM-7B, Weight Bits=4, Activation Bits=42026.06 | 63.59 | |
| DLLMQuant++Backbone=DREAM-7B, Weight Bits=4, Activation Bits=42026.06 | 61.9 | |
| QuaRotBackbone=LLADA-1.5-8B, Weight Bits=4, Activation Bits=42026.06 | 61.06 | |
| DLLMQuant+Backbone=LLADA-1.5-8B, Weight Bits=4, Activation Bits=42026.06 | 59.94 | |
| FPBackbone=LLADA-8B, Weight Bits=Full Precision, Activation Bits=Full Precision2026.06 | 58.99 | |
| QuaRotBackbone=DREAM-7B, Weight Bits=4, Activation Bits=42026.06 | 58.85 | |
| AWQBackbone=LLADA-1.5-8B, Weight Bits=4, Activation Bits=42026.06 | 58.49 | |
| STaR-QuantBackbone=LLADA-8B, Weight Bits=4, Activation Bits=42026.06 | 57.07 | |
| DLLMQuant+Backbone=DREAM-7B, Weight Bits=4, Activation Bits=42026.06 | 56.19 | |
| AWQBackbone=DREAM-7B, Weight Bits=4, Activation Bits=42026.06 | 54.89 | |
| DLLMQuant++Backbone=LLADA-8B, Weight Bits=4, Activation Bits=42026.06 | 54.29 | |
| RTNBackbone=LLADA-1.5-8B, Weight Bits=4, Activation Bits=42026.06 | 53.12 | |
| QuaRotBackbone=LLADA-8B, Weight Bits=4, Activation Bits=42026.06 | 51.03 | |
| RTNBackbone=DREAM-7B, Weight Bits=4, Activation Bits=42026.06 | 49.53 | |
| DLLMQuant+Backbone=LLADA-8B, Weight Bits=4, Activation Bits=42026.06 | 49.26 | |
| AWQBackbone=LLADA-8B, Weight Bits=4, Activation Bits=42026.06 | 48.09 | |
| RTNBackbone=LLADA-8B, Weight Bits=4, Activation Bits=42026.06 | 44.23 |