Text Generation on Text Generation
11.9PPLDense
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| DensePruning Ratio=0%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 11.9 | — | — | — | |
| DensePruning Ratio=0%, Backbone=LLaMA-2-7B, Zero-shot=true2025.12 | 12.18 | — | — | — | |
| DensePruning Ratio=0%, Backbone=LLaMA-3-8B, Zero-shot=true2025.12 | 14.13 | — | — | — | |
| PPPruning Ratio=20%, Backbone=LLaMA-2-7B, Zero-shot=true2025.12 | 15.31 | — | — | — | |
| Token FilteringPruning Ratio=20%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 15.52 | — | — | — | |
| FLAPPruning Ratio=20%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 16.08 | — | — | — | |
| DensePruning Ratio=0%, Backbone=Phi-4-14B, Zero-shot=true2025.12 | 16.2 | — | — | — | |
| FLAPPruning Ratio=20%, Backbone=LLaMA-2-7B, Zero-shot=true2025.12 | 16.32 | — | — | — | |
| SlimGPT w/oPruning Ratio=20%, Backbone=LLaMA-2-7B, Zero-shot=true2025.12 | 16.36 | — | — | — | |
| Token FilteringPruning Ratio=20%, Backbone=LLaMA-2-7B, Zero-shot=true2025.12 | 16.65 | — | — | — | |
| GPT-4KG integration=KG-BERT2025.12 | 18.9 | 38.1 | 42.3 | 5.4 | |
| Token FilteringPruning Ratio=20%, Backbone=LLaMA-3-8B, Zero-shot=true2025.12 | 19.46 | — | — | — | |
| SlimGPT w/oPruning Ratio=20%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 20.39 | — | — | — | |
| Token FilteringPruning Ratio=20%, Backbone=Phi-4-14B, Zero-shot=true2025.12 | 20.52 | — | — | — | |
| PPPruning Ratio=20%, Backbone=LLaMA-3-8B, Zero-shot=true2025.12 | 20.56 | — | — | — | |
| FLAPPruning Ratio=20%, Backbone=LLaMA-3-8B, Zero-shot=true2025.12 | 23.25 | — | — | — | |
| ClaudeKG integration=KG-BERT2025.12 | 23.4 | 30.2 | 35.5 | 3.2 | |
| Mistral IAKG integration=KG-BERT2025.12 | 25.8 | 28.7 | 33.1 | 2.7 | |
| SlimGPT w/oPruning Ratio=20%, Backbone=LLaMA-3-8B, Zero-shot=true2025.12 | 32.79 | — | — | — | |
| PPPruning Ratio=50%, Backbone=LLaMA-2-7B, Zero-shot=true2025.12 | 39.4 | — | — | — | |
| SlimGPT w/oPruning Ratio=50%, Backbone=LLaMA-2-7B, Zero-shot=true2025.12 | 40.83 | — | — | — | |
| FLAPPruning Ratio=50%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 42.02 | — | — | — | |
| FLAPPruning Ratio=50%, Backbone=LLaMA-2-7B, Zero-shot=true2025.12 | 43.11 | — | — | — | |
| SlimGPT w/oPruning Ratio=50%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 43.68 | — | — | — | |
| Token FilteringPruning Ratio=50%, Backbone=Mistral-7B, Zero-shot=true2025.12 | 48.08 | — | — | — | |
| Token FilteringPruning Ratio=50%, Backbone=LLaMA-2-7B, Zero-shot=true2025.12 | 54.59 | — | — | — | |
| FLAPPruning Ratio=50%, Backbone=LLaMA-3-8B, Zero-shot=true2025.12 | 63.33 | — | — | — | |
| Token FilteringPruning Ratio=50%, Backbone=Phi-4-14B, Zero-shot=true2025.12 | 72.89 | — | — | — | |
| Token FilteringPruning Ratio=50%, Backbone=LLaMA-3-8B, Zero-shot=true2025.12 | 74.62 | — | — | — | |
| SlimGPT w/oPruning Ratio=50%, Backbone=LLaMA-3-8B, Zero-shot=true2025.12 | 85.32 | — | — | — | |
| PPPruning Ratio=50%, Backbone=LLaMA-3-8B, Zero-shot=true2025.12 | 104.01 | — | — | — | |
| SlimGPT w/oPruning Ratio=20%, Backbone=Phi-4-14B, Zero-shot=true2025.12 | 191.31 | — | — | — | |
| SlimGPT w/oPruning Ratio=50%, Backbone=Phi-4-14B, Zero-shot=true2025.12 | 512.32 | — | — | — |