List your company
ResearchFormerly WizWand

Classification on ARC-c

50.77AccuracyI-GLASS
29.824435.262240.746.1378Aug 19, 2025
Updated 5mo ago

Evaluation results

MethodLinks
I-GLASSBackbone=Mistral 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0850.77
GRIFFINBackbone=Gemma 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0850.09
GRIFFINBackbone=Mistral 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0850.09
I-GLASSBackbone=Gemma 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0849.83
I-GLASSBackbone=Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0843.52
GRIFFINBackbone=Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0843.52
I-GLASSBackbone=ReLU-Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0839.25
GRIFFINBackbone=ReLU-Llama2 7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0839.25
I-GLASSBackbone=OPT 6.7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0830.72
GRIFFINBackbone=OPT 6.7B, Sparsity=50% FF, Evaluation Protocol=0-shot unnormalized2025.0830.63