List your company
ResearchFormerly WizWand

Language Generation on CoQA

65.5AccuracyE2E Caprese
53.95656.95359.9562.947May 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
E2E CapreseBase Model=Llama 3.1 8B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0565.5
Layer-wise CapreseBase Model=Llama 3.1 8B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0565.05
E2E CapreseBase Model=Gemma 2 9B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0564.87
E2E CapreseBase Model=Llama 3.2 3B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0564.83
GRIFFINBase Model=Llama 3.2 3B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0564.52
Layer-wise CapreseBase Model=Gemma 2 9B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0564.52
E2E CapreseBase Model=Gemma 2 9B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0564.42
CATSBase Model=Gemma 2 9B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0564.37
Layer-wise CapreseBase Model=Llama 3.2 3B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0564.33
E2E CapreseBase Model=Llama 3.1 8B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0564.27
Layer-wise CapreseBase Model=Gemma 2 9B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0564.2
Llama 3.2 3B InstructPrompting=0-shot, FF Sparsity=50%2025.0563.95
Layer-wise CapreseBase Model=Llama 3.1 8B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0563.92
E2E CapreseBase Model=Gemma 2 2B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0563.92
Llama 3.1 8B InstructPrompting=0-shot, FF Sparsity=50%2025.0563.88
GRIFFINBase Model=Gemma 2 9B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0563.82
Gemma 2 9B InstructPrompting=0-shot, FF Sparsity=50%2025.0563.78
Gemma 2 2B InstructPrompting=0-shot, FF Sparsity=50%2025.0563.77
Layer-wise CapreseBase Model=Gemma 2 2B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0563.77
GRIFFINBase Model=Llama 3.1 8B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0563.37
E2E CapreseBase Model=Gemma 2 2B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0563.37
GRIFFINBase Model=Gemma 2 2B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0563.28
Layer-wise CapreseBase Model=Gemma 2 2B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0561.92
E2E CapreseBase Model=Llama 3.2 3B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0561.72
CATSBase Model=Gemma 2 2B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0561.53
Layer-wise CapreseBase Model=Llama 3.2 3B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0560.53
CATSBase Model=Llama 3.2 3B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0558.87
CATSBase Model=Llama 3.1 8B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0558.85
E2E CapreseBase Model=Llama 3.2 1B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0556.55
E2E CapreseBase Model=Llama 3.2 1B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0556.12
Layer-wise CapreseBase Model=Llama 3.2 1B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0556.07
GRIFFINBase Model=Llama 3.2 1B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0556.05
Layer-wise CapreseBase Model=Llama 3.2 1B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0555.58
Llama 3.2 1B InstructPrompting=0-shot, FF Sparsity=50%2025.0555.43
CATSBase Model=Llama 3.2 1B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0554.4