Short Generation on XSum
27.27ROUGE-1I-GLASS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| I-GLASSBackbone=Mistral 7B, Sparsity=50% FF2025.08 | 27.27 | 8.7 | 22.37 | |
| I-GLASSBackbone=Llama2 7B, Sparsity=50% FF2025.08 | 27.18 | 9.06 | 22.62 | |
| GRIFFINBackbone=Llama2 7B, Sparsity=50% FF2025.08 | 27.18 | 9.06 | 22.62 | |
| GRIFFINBackbone=Mistral 7B, Sparsity=50% FF2025.08 | 27.03 | 8.95 | 22.39 | |
| I-GLASSBackbone=Gemma 7B, Sparsity=50% FF2025.08 | 25.74 | 7.69 | 20.75 | |
| GRIFFINBackbone=Gemma 7B, Sparsity=50% FF2025.08 | 25.36 | 7.67 | 20.48 | |
| I-GLASSBackbone=ReLU-Llama2 7B, Sparsity=50% FF2025.08 | 24.66 | 7.45 | 20.36 | |
| GRIFFINBackbone=ReLU-Llama2 7B, Sparsity=50% FF2025.08 | 24.66 | 7.45 | 20.36 | |
| GRIFFINBackbone=OPT 6.7B, Sparsity=50% FF2025.08 | 21.18 | 5.36 | 17.68 | |
| I-GLASSBackbone=OPT 6.7B, Sparsity=50% FF2025.08 | 19.95 | 4.54 | 16.47 |