List your company
ResearchFormerly WizWand

Zero-shot Prediction on HellaSwag

76.36Zero-shot HellaSwag AccuracyBF16
23.725637.390351.05564.7197Oct 2, 2025Nov 9, 2025Dec 18, 2025Jan 26, 2026Mar 6, 2026Apr 14, 2026May 23, 2026
Updated 5mo ago

Evaluation results

MethodLinks
BF16Model=Ouro 2.6B, Quantization=W4A42026.0576.36
LoopQModel=Ouro 2.6B, Quantization=W4A82026.0575.55
BF16Model=Ouro 1.4B, Quantization=W4A42026.0571.59
BF16Model=Ouro 1.4B, Quantization=W4A82026.0571.59
LoopQModel=Ouro 1.4B, Quantization=W4A82026.0569.54
FlatQuantModel=Ouro 1.4B, Quantization=W4A82026.0569.48
LoopQModel=Ouro 2.6B, Quantization=W4A42026.0568.6
QuaRotModel=Ouro 1.4B, Quantization=W4A82026.0568.17
LoopQModel=Ouro 1.4B, Quantization=W4A42026.0565.82
SmoothQuantModel=Ouro 1.4B, Quantization=W4A82026.0560.1
DenseSparsity=0%, Backbone=LLaMA-2-7B, Zero-shot=true2025.1057.14
SymmetricModel=Ouro 1.4B, Quantization=W4A82026.0550.22
MagnitudeSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1050.05
ELSASparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1049.9
L-ADMMSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1049.45
ALPSSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1049.4
SAFESparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1048.55
SpinQuantModel=Ouro 1.4B, Quantization=W4A82026.0548.38
SparseLLMSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1048.28
SparseGPTSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1048.26
ELSASparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1047.87
WandaSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1046.98
ALPSSparsity=4:8, Backbone=LLaMA-2-7B, Zero-shot=true2025.1045.96
MagnitudeSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1045.45
L-ADMMSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1045.05
SAFESparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1044.66
LoopQModel=Parcae 370M, Quantization=W4A82026.0544.11
SparseLLMSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1043.62
SparseGPTSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1043.47
LoopQModel=Parcae 370M, Quantization=W4A42026.0541.74
WandaSparsity=2:4, Backbone=LLaMA-2-7B, Zero-shot=true2025.1041.28
LoopQModel=LoopFormer 3×8, Quantization=W4A82026.0531.99
TMMFormer2026.0531.82
LoopQModel=LoopFormer 3×8, Quantization=W4A42026.0531.79
AdamFormer2026.0530.96
VanillaTransformer2026.0530.2
AdamWFormer2026.0530.08
SpinQuantModel=Ouro 1.4B, Quantization=W4A42026.0529.14
QuaRotModel=Ouro 1.4B, Quantization=W4A42026.0529.08
SymmetricModel=Ouro 2.6B, Quantization=W4A42026.0528.11
SymmetricModel=Ouro 1.4B, Quantization=W4A42026.0527.77
FlatQuantModel=Ouro 1.4B, Quantization=W4A42026.0526.98
SmoothQuantModel=Ouro 1.4B, Quantization=W4A42026.0525.75