List your company
ResearchFormerly WizWand

Language Modeling on Perplexity Evaluation (zero-shot)

10.98PPL (zero-shot)Dense
10.112415.968721.82527.6813Dec 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DensePruning Ratio=0%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1210.98
PPPruning Ratio=20%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1212.52
PPPruning Ratio=25%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1213.32
Token FilteringPruning Ratio=20%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1213.37
SlimGPT w/oPruning Ratio=20%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1213.8
FLAPPruning Ratio=20%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1214.13
Token FilteringPruning Ratio=25%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1214.69
SlimGPT w/oPruning Ratio=25%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1215.1
FLAPPruning Ratio=25%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1215.49
PPPruning Ratio=33%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1215.83
Token FilteringPruning Ratio=33%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1216.39
FLAPPruning Ratio=33%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1217.79
SlimGPT w/oPruning Ratio=33%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1218.11
PPPruning Ratio=50%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1228.86
Token FilteringPruning Ratio=50%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1229.22
FLAPPruning Ratio=50%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1229.45
SlimGPT w/oPruning Ratio=50%, Base Model=LLaMA-2-13B, Zero-shot=true2025.1232.67