MLP neuron selection on Professions
0.24ℓ(D, m)random
Evaluation Results
| Method | Links | |
|---|---|---|
| randomModel=GPT2-large, Sparsity level=≤2.5%, Execution time (hours)=1.352026.06 | 0.24 | |
| randomModel=GPT2-medium, Sparsity level=≤2.5%, Execution time (hours)=0.712026.06 | 0.25 | |
| randomModel=GPT2-xl, Sparsity level=≤2.5%, Execution time (hours)=2.522026.06 | 0.28 | |
| randomModel=GPT2-small, Sparsity level=≤2.5%, Execution time (hours)=0.322026.06 | 0.34 | |
| randomModel=DistilGPT2, Sparsity level=≤2.5%, Execution time (hours)=0.212026.06 | 0.36 | |
| randomModel=GPT2-large, Sparsity level=≤5%, Execution time (hours)=1.352026.06 | 0.39 | |
| randomModel=GPT2-medium, Sparsity level=≤5%, Execution time (hours)=0.712026.06 | 0.48 | |
| randomModel=GPT2-small, Sparsity level=≤5%, Execution time (hours)=0.322026.06 | 0.56 | |
| randomModel=GPT2-xl, Sparsity level=≤5%, Execution time (hours)=2.522026.06 | 0.63 | |
| randomModel=DistilGPT2, Sparsity level=≤5%, Execution time (hours)=0.212026.06 | 0.72 | |
| randomModel=GPT2-large, Sparsity level=≤10%, Execution time (hours)=1.352026.06 | 0.85 | |
| randomModel=Llama3.2-1B, Sparsity level=≤2.5%, Execution time (hours)=0.802026.06 | 1.13 | |
| randomModel=GPT2-medium, Sparsity level=≤10%, Execution time (hours)=0.712026.06 | 1.35 | |
| randomModel=GPT2-xl, Sparsity level=≤10%, Execution time (hours)=2.522026.06 | 1.46 | |
| randomModel=Llama3.2-1B, Sparsity level=≤5%, Execution time (hours)=0.802026.06 | 1.51 | |
| randomModel=GPT2-small, Sparsity level=≤10%, Execution time (hours)=0.322026.06 | 1.54 | |
| randomModel=GPT2-large, Sparsity level=≤15%, Execution time (hours)=1.352026.06 | 1.57 | |
| randomModel=DistilGPT2, Sparsity level=≤10%, Execution time (hours)=0.212026.06 | 1.59 | |
| randomModel=Llama3.2-1B, Sparsity level=≤10%, Execution time (hours)=0.802026.06 | 1.94 | |
| randomModel=Llama3.2-1B, Sparsity level=≤15%, Execution time (hours)=0.802026.06 | 2.03 | |
| randomModel=Qwen3-1.7B, Sparsity level=≤2.5%, Execution time (hours)=2.042026.06 | 2.15 | |
| randomModel=GPT2-medium, Sparsity level=≤15%, Execution time (hours)=0.712026.06 | 2.77 | |
| randomModel=GPT2-small, Sparsity level=≤15%, Execution time (hours)=0.322026.06 | 2.87 | |
| randomModel=Qwen3-1.7B, Sparsity level=≤5%, Execution time (hours)=2.042026.06 | 2.88 | |
| randomModel=DistilGPT2, Sparsity level=≤15%, Execution time (hours)=0.212026.06 | 3.02 | |
| randomModel=GPT2-xl, Sparsity level=≤15%, Execution time (hours)=2.522026.06 | 3.12 | |
| randomModel=Qwen3-1.7B, Sparsity level=≤10%, Execution time (hours)=2.042026.06 | 3.54 | |
| randomModel=Qwen3-1.7B, Sparsity level=≤15%, Execution time (hours)=2.042026.06 | 3.55 | |
| PGB-CTModel=DistilGPT2, Sparsity level=≤2.5%, Execution time (hours)=0.022026.06 | 11.76 | |
| top-kModel=DistilGPT2, Sparsity level=≤2.5%, Execution time (hours)=0.972026.06 | 14.86 | |
| top-kModel=GPT2-small, Sparsity level=≤2.5%, Execution time (hours)=2.972026.06 | 30.23 | |
| top-kModel=DistilGPT2, Sparsity level=≤5%, Execution time (hours)=0.972026.06 | 47.23 | |
| PGB-CTModel=GPT2-small, Sparsity level=≤2.5%, Execution time (hours)=0.032026.06 | 47.54 | |
| PGB-CTModel=DistilGPT2, Sparsity level=≤5%, Execution time (hours)=0.022026.06 | 58.33 | |
| top-kModel=GPT2-medium, Sparsity level=≤2.5%, Execution time (hours)=17.372026.06 | 61.63 | |
| top-kModel=GPT2-small, Sparsity level=≤5%, Execution time (hours)=2.972026.06 | 84.71 | |
| top-kModel=GPT2-medium, Sparsity level=≤5%, Execution time (hours)=17.372026.06 | 103.18 | |
| top-kModel=DistilGPT2, Sparsity level=≤10%, Execution time (hours)=0.972026.06 | 103.79 | |
| top-kModel=GPT2-medium, Sparsity level=≤15%, Execution time (hours)=17.372026.06 | 125.03 | |
| top-kModel=GPT2-medium, Sparsity level=≤10%, Execution time (hours)=17.372026.06 | 125.45 | |
| top-kModel=GPT2-small, Sparsity level=≤10%, Execution time (hours)=2.972026.06 | 127.32 | |
| top-kModel=GPT2-small, Sparsity level=≤15%, Execution time (hours)=2.972026.06 | 140.8 | |
| PGB-CTModel=GPT2-small, Sparsity level=≤5%, Execution time (hours)=0.032026.06 | 146.4 | |
| top-kModel=DistilGPT2, Sparsity level=≤15%, Execution time (hours)=0.972026.06 | 149.28 | |
| PGB-CTModel=DistilGPT2, Sparsity level=≤10%, Execution time (hours)=0.022026.06 | 313.17 | |
| PGB-CTModel=GPT2-large, Sparsity level=≤2.5%, Execution time (hours)=0.142026.06 | 437.33 | |
| PGB-CTModel=GPT2-medium, Sparsity level=≤2.5%, Execution time (hours)=0.072026.06 | 1,311.8 | |
| PGB-CTModel=GPT2-small, Sparsity level=≤10%, Execution time (hours)=0.032026.06 | 1,320.25 | |
| PGB-CTModel=DistilGPT2, Sparsity level=≤15%, Execution time (hours)=0.022026.06 | 2,308.08 | |
| PGB-CTModel=Llama3.2-1B, Sparsity level=≤2.5%, Execution time (hours)=0.092026.06 | 3,470.68 | |
| PGB-CTModel=GPT2-small, Sparsity level=≤15%, Execution time (hours)=0.032026.06 | 8,654.82 | |
| PGB-CTModel=Llama3.2-1B, Sparsity level=≤5%, Execution time (hours)=0.092026.06 | 11,000 | |
| PGB-CTModel=GPT2-xl, Sparsity level=≤2.5%, Execution time (hours)=0.252026.06 | 18,852 | |
| PGB-CTModel=Llama3.2-1B, Sparsity level=≤10%, Execution time (hours)=0.092026.06 | 22,000 | |
| PGB-CTModel=Llama3.2-1B, Sparsity level=≤15%, Execution time (hours)=0.092026.06 | 25,000 | |
| PGB-CTModel=GPT2-xl, Sparsity level=≤5%, Execution time (hours)=0.252026.06 | 190,000 | |
| PGB-CTModel=GPT2-large, Sparsity level=≤5%, Execution time (hours)=0.142026.06 | 1,700,000 | |
| PGB-CTModel=GPT2-medium, Sparsity level=≤5%, Execution time (hours)=0.072026.06 | 68,000,000 | |
| PGB-CTModel=GPT2-medium, Sparsity level=≤10%, Execution time (hours)=0.072026.06 | 68,000,000 | |
| PGB-CTModel=GPT2-medium, Sparsity level=≤15%, Execution time (hours)=0.072026.06 | 68,000,000 | |
| PGB-CTModel=GPT2-large, Sparsity level=≤10%, Execution time (hours)=0.142026.06 | 6,900,000,000 | |
| PGB-CTModel=GPT2-large, Sparsity level=≤15%, Execution time (hours)=0.142026.06 | 6,900,000,000 | |
| PGB-CTModel=GPT2-xl, Sparsity level=≤10%, Execution time (hours)=0.252026.06 | 61,000,000,000 | |
| PGB-CTModel=Qwen3-1.7B, Sparsity level=≤2.5%, Execution time (hours)=0.202026.06 | 61,000,000,000 | |
| PGB-CTModel=Qwen3-1.7B, Sparsity level=≤5%, Execution time (hours)=0.202026.06 | 210,000,000,000 | |
| PGB-CTModel=Qwen3-1.7B, Sparsity level=≤10%, Execution time (hours)=0.202026.06 | 210,000,000,000 | |
| PGB-CTModel=Qwen3-1.7B, Sparsity level=≤15%, Execution time (hours)=0.202026.06 | 210,000,000,000 | |
| PGB-CTModel=GPT2-xl, Sparsity level=≤15%, Execution time (hours)=0.252026.06 | 660,000,000,000 |