List your company

Code Generation on HumanEval (var@10, var@100, Pres.)

35.88Variation Rate @ k=10Dense
7.477614.851322.22529.5987Jun 4, 2026

Evaluation results

MethodLinks
DenseBackbone=CodeLlama-7B-Python, Compression Ratio=0%2026.0635.8820.06100
SecRL-PruneBackbone=Qwen2.5-Coder-7B-Instruct, Compression Ratio=10%2026.0635.7213.44105.2
DenseBackbone=Qwen2.5-Coder-7B-Instruct, Compression Ratio=0%2026.0634.7112.5100
DenseBackbone=CodeLlama-7B-Instruct, Compression Ratio=0%2026.0633.8915.24100
SecRL-PruneBackbone=CodeLlama-7B-Instruct, Compression Ratio=10%2026.0631.9712.2287.3
SecRL-PruneBackbone=CodeLlama-7B-Python, Compression Ratio=10%2026.0629.4415.0478.5
PruneNetBackbone=Qwen2.5-Coder-7B-Instruct, Compression Ratio=10%2026.0629.3312.0890.6
SecRL-PruneBackbone=Qwen2.5-Coder-7B-Instruct, Compression Ratio=25%2026.0627.7112.3789.4
SecRL-PruneBackbone=Qwen2.5-Coder-7B-Instruct, Compression Ratio=20%2026.0627.1212.1787.7
SecRL-PruneBackbone=CodeLlama-7B-Instruct, Compression Ratio=20%2026.0626.989.571
SecRL-PruneBackbone=CodeLlama-7B-Python, Compression Ratio=20%2026.0626.9610.3963.5
PruneNetBackbone=CodeLlama-7B-Instruct, Compression Ratio=10%2026.0626.627.1162.6
SecRL-PruneBackbone=Qwen2.5-Coder-7B-Instruct, Compression Ratio=30%2026.0626.4812.1786.8
SecRL-PruneBackbone=CodeLlama-7B-Instruct, Compression Ratio=25%2026.0623.648.2561.9
SecRL-PruneBackbone=CodeLlama-7B-Python, Compression Ratio=25%2026.06238.7253.8
PruneNetBackbone=CodeLlama-7B-Python, Compression Ratio=10%2026.0622.186.0546
SecRL-PruneBackbone=CodeLlama-7B-Python, Compression Ratio=30%2026.0620.537.5547.4
PruneNetBackbone=Qwen2.5-Coder-7B-Instruct, Compression Ratio=20%2026.0620.2410.2370.1
SecRL-PruneBackbone=CodeLlama-7B-Instruct, Compression Ratio=30%2026.0618.917.0851.1
PruneNetBackbone=CodeLlama-7B-Instruct, Compression Ratio=20%2026.0618.84.7543.3
PruneNetBackbone=Qwen2.5-Coder-7B-Instruct, Compression Ratio=25%2026.0618.519.7465.6
PruneNetBackbone=Qwen2.5-Coder-7B-Instruct, Compression Ratio=30%2026.0616.729.2160.9
PruneNetBackbone=CodeLlama-7B-Python, Compression Ratio=20%2026.0616.464.1933.4
PruneNetBackbone=CodeLlama-7B-Instruct, Compression Ratio=25%2026.0614.273.5632.7
PruneNetBackbone=CodeLlama-7B-Python, Compression Ratio=25%2026.0612.432.6323.9
PruneNetBackbone=CodeLlama-7B-Instruct, Compression Ratio=30%2026.069.832.6723.3
PruneNetBackbone=CodeLlama-7B-Python, Compression Ratio=30%2026.068.571.7516.3