Short-Generation on QASPER
72.73F1 ScoreI-GLASS
Evaluation Results
| Method | Links | |
|---|---|---|
| I-GLASSBackbone=Mistral 7B, Sparsity=50% FF2025.08 | 72.73 | |
| GRIFFINBackbone=Mistral 7B, Sparsity=50% FF2025.08 | 72.73 | |
| I-GLASSBackbone=Llama2 7B, Sparsity=50% FF2025.08 | 67.31 | |
| GRIFFINBackbone=Llama2 7B, Sparsity=50% FF2025.08 | 67.31 | |
| I-GLASSBackbone=Gemma 7B, Sparsity=50% FF2025.08 | 67.13 | |
| GRIFFINBackbone=Gemma 7B, Sparsity=50% FF2025.08 | 67.13 | |
| I-GLASSBackbone=OPT 6.7B, Sparsity=50% FF2025.08 | 64.54 | |
| GRIFFINBackbone=OPT 6.7B, Sparsity=50% FF2025.08 | 64.54 | |
| I-GLASSBackbone=ReLU-Llama2 7B, Sparsity=50% FF2025.08 | 60.35 | |
| GRIFFINBackbone=ReLU-Llama2 7B, Sparsity=50% FF2025.08 | 60.35 |