List your company
ResearchFormerly WizWand

Language Generation on CNN/DailyMail

27.16AccuracyE2E Caprese
22.043223.371624.726.0284May 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
E2E CapreseBase Model=Gemma 2 2B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0527.16
Layer-wise CapreseBase Model=Gemma 2 9B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0526.88
GRIFFINBase Model=Gemma 2 9B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0526.77
CATSBase Model=Gemma 2 9B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0526.64
E2E CapreseBase Model=Gemma 2 2B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0526.52
CATSBase Model=Gemma 2 2B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0526.46
Gemma 2 9B InstructPrompting=0-shot, FF Sparsity=50%2025.0526.46
Layer-wise CapreseBase Model=Gemma 2 9B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0526.45
E2E CapreseBase Model=Llama 3.1 8B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0526.42
Layer-wise CapreseBase Model=Gemma 2 2B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0526.37
E2E CapreseBase Model=Gemma 2 9B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0526.33
Layer-wise CapreseBase Model=Llama 3.1 8B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0526.31
Layer-wise CapreseBase Model=Gemma 2 2B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0526.23
Llama 3.2 3B InstructPrompting=0-shot, FF Sparsity=50%2025.0526.2
Layer-wise CapreseBase Model=Llama 3.2 1B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0526.18
E2E CapreseBase Model=Llama 3.2 1B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0526.18
E2E CapreseBase Model=Llama 3.1 8B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0526.13
E2E CapreseBase Model=Llama 3.2 3B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0526.04
Gemma 2 2B InstructPrompting=0-shot, FF Sparsity=50%2025.0526.01
Llama 3.1 8B InstructPrompting=0-shot, FF Sparsity=50%2025.0525.98
Layer-wise CapreseBase Model=Llama 3.2 3B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0525.9
Layer-wise CapreseBase Model=Llama 3.2 3B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0525.9
GRIFFINBase Model=Llama 3.1 8B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0525.89
Layer-wise CapreseBase Model=Llama 3.1 8B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0525.79
CATSBase Model=Llama 3.1 8B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0525.67
Llama 3.2 1B InstructPrompting=0-shot, FF Sparsity=50%2025.0525.6
E2E CapreseBase Model=Llama 3.2 1B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0525.56
GRIFFINBase Model=Llama 3.2 3B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0525.49
GRIFFINBase Model=Llama 3.2 1B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0525.47
E2E CapreseBase Model=Gemma 2 9B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.0525.47
CATSBase Model=Llama 3.2 3B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0525.4
E2E CapreseBase Model=Llama 3.2 3B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0525.4
Layer-wise CapreseBase Model=Llama 3.2 1B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.0525.35
CATSBase Model=Llama 3.2 1B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0524.73
GRIFFINBase Model=Gemma 2 2B Instruct, Prompting=0-shot, FF Sparsity=50%2025.0522.24