Language Generation on XSum (accuracy)
24.89AccuracyE2E Caprese
Evaluation Results
| Method | Links | |
|---|---|---|
| E2E CapreseBase Model=Gemma 2 9B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.05 | 24.89 | |
| Layer-wise CapreseBase Model=Gemma 2 9B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.05 | 24.88 | |
| CATSBase Model=Gemma 2 9B Instruct, Prompting=0-shot, FF Sparsity=50%2025.05 | 24.74 | |
| GRIFFINBase Model=Gemma 2 9B Instruct, Prompting=0-shot, FF Sparsity=50%2025.05 | 24.66 | |
| E2E CapreseBase Model=Gemma 2 9B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.05 | 24.65 | |
| Layer-wise CapreseBase Model=Gemma 2 9B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.05 | 24.54 | |
| Gemma 2 9B InstructPrompting=0-shot, FF Sparsity=50%2025.05 | 23.98 | |
| Llama 3.2 3B InstructPrompting=0-shot, FF Sparsity=50%2025.05 | 23.22 | |
| Layer-wise CapreseBase Model=Llama 3.1 8B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.05 | 22.58 | |
| Layer-wise CapreseBase Model=Llama 3.2 3B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.05 | 22.5 | |
| E2E CapreseBase Model=Gemma 2 2B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.05 | 22.48 | |
| CATSBase Model=Llama 3.2 3B Instruct, Prompting=0-shot, FF Sparsity=50%2025.05 | 22.23 | |
| Gemma 2 2B InstructPrompting=0-shot, FF Sparsity=50%2025.05 | 22.17 | |
| E2E CapreseBase Model=Gemma 2 2B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.05 | 22.15 | |
| Layer-wise CapreseBase Model=Gemma 2 2B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.05 | 22.1 | |
| GRIFFINBase Model=Llama 3.2 3B Instruct, Prompting=0-shot, FF Sparsity=50%2025.05 | 22.09 | |
| E2E CapreseBase Model=Llama 3.1 8B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.05 | 22.08 | |
| E2E CapreseBase Model=Llama 3.1 8B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.05 | 22.05 | |
| Llama 3.1 8B InstructPrompting=0-shot, FF Sparsity=50%2025.05 | 21.97 | |
| CATSBase Model=Gemma 2 2B Instruct, Prompting=0-shot, FF Sparsity=50%2025.05 | 21.97 | |
| Layer-wise CapreseBase Model=Llama 3.1 8B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.05 | 21.92 | |
| Llama 3.2 1B InstructPrompting=0-shot, FF Sparsity=50%2025.05 | 21.65 | |
| Layer-wise CapreseBase Model=Gemma 2 2B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.05 | 21.63 | |
| E2E CapreseBase Model=Llama 3.2 3B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.05 | 21.58 | |
| Layer-wise CapreseBase Model=Llama 3.2 3B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.05 | 21.56 | |
| GRIFFINBase Model=Llama 3.1 8B Instruct, Prompting=0-shot, FF Sparsity=50%2025.05 | 21.53 | |
| CATSBase Model=Llama 3.1 8B Instruct, Prompting=0-shot, FF Sparsity=50%2025.05 | 21.43 | |
| E2E CapreseBase Model=Llama 3.2 3B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.05 | 21.26 | |
| GRIFFINBase Model=Llama 3.2 1B Instruct, Prompting=0-shot, FF Sparsity=50%2025.05 | 21.13 | |
| CATSBase Model=Llama 3.2 1B Instruct, Prompting=0-shot, FF Sparsity=50%2025.05 | 21.1 | |
| Layer-wise CapreseBase Model=Llama 3.2 1B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.05 | 20.94 | |
| E2E CapreseBase Model=Llama 3.2 1B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.05 | 20.71 | |
| Layer-wise CapreseBase Model=Llama 3.2 1B Instruct, Framework=GRIFFIN, Prompting=0-shot, FF Sparsity=50%2025.05 | 20.65 | |
| E2E CapreseBase Model=Llama 3.2 1B Instruct, Framework=CATS, Prompting=0-shot, FF Sparsity=50%2025.05 | 20.4 | |
| GRIFFINBase Model=Gemma 2 2B Instruct, Prompting=0-shot, FF Sparsity=50%2025.05 | 18.27 |