List your company

Zero-shot Evaluation Suite (WikiText2, PTB, BoolQ, PIQA, HellaSwag, WinoGrande, ARC, OBQA)

28.99PTB PerplexityLLaMA-2-7B
19.81281.7635143.715205.6665Mar 16, 2024

Evaluation results

MethodLinks
LLaMA-2-7BRatio=0%2024.0328.9913.9942.9776.0670.0265.5163.0536.5240.856.42—
HyWIAPruning Ratio=20%, Evaluation Protocol=Zero-shot2024.0329.61—72.7877.3368.7466.5664.2938.144261.3516.63
Vicuna-7BPruning Ratio=0%, Evaluation Protocol=Zero-shot2024.0358.19—75.6677.871.0567.6465.0239.9342.262.7616.23
LLM-Pruner VectorPruning Ratio=20%, Evaluation Protocol=Zero-shot2024.0374.66—63.1574.5961.9560.360.4836.639.456.6419.94
LLM-Pruner Element²Pruning Ratio=20%, Evaluation Protocol=Zero-shot2024.0376.78—60.475.6365.4563.2263.0537.713957.7818.97
HyWIARatio=50%2024.03174.1966.3738.2670.7351.6153.9149.0330.7236.647.26—
LLM-Pruner VectorRatio=50%2024.03214.2590.0138.2669.5347.9852.4948.4428.163645.84—
LLM-Pruner Element²Ratio=50%2024.03258.4499.6337.2168.7749.3151.2846.5128.535.245.25—