Short Generation on CNN/DailyMail
21.15ROUGE-1I-GLASS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| I-GLASSBackbone=ReLU-Llama2 7B, Sparsity=50% FF2025.08 | 21.15 | 6.83 | 19.48 | |
| GRIFFINBackbone=ReLU-Llama2 7B, Sparsity=50% FF2025.08 | 21.15 | 6.83 | 19.48 | |
| I-GLASSBackbone=Gemma 7B, Sparsity=50% FF2025.08 | 18.97 | 4.78 | 17.31 | |
| GRIFFINBackbone=Gemma 7B, Sparsity=50% FF2025.08 | 18.26 | 4.74 | 16.75 | |
| GRIFFINBackbone=OPT 6.7B, Sparsity=50% FF2025.08 | 12.99 | 1.05 | 12.25 | |
| I-GLASSBackbone=OPT 6.7B, Sparsity=50% FF2025.08 | 12.27 | 0.69 | 11.59 | |
| I-GLASSBackbone=Llama2 7B, Sparsity=50% FF2025.08 | 10.07 | 0.13 | 9.55 | |
| GRIFFINBackbone=Llama2 7B, Sparsity=50% FF2025.08 | 10.07 | 0.13 | 9.55 | |
| GRIFFINBackbone=Mistral 7B, Sparsity=50% FF2025.08 | 1.03 | 0.2 | 0.92 | |
| I-GLASSBackbone=Mistral 7B, Sparsity=50% FF2025.08 | 0.59 | 0.06 | 0.55 |