List your company
ResearchFormerly WizWand

Code Generation on EvalPlus (test)

86.7Eval+Full
-3.46819.94143.3566.759Mar 19, 2026
Updated 7mo ago

Evaluation results

MethodLinks
FullModel=ERNIE-21B, Pruning Ratio=0%, Protocol=Zero-shot2026.0386.7
AIMERModel=ERNIE-21B, Pruning Ratio=25%, Protocol=Zero-shot2026.0373.4
MagnitudeModel=ERNIE-21B, Pruning Ratio=25%, Protocol=Zero-shot2026.0368.7
RandomModel=ERNIE-21B, Pruning Ratio=25%, Protocol=Zero-shot2026.0366.2
FullModel=OLMoE-7B, Pruning Ratio=0%, Protocol=Zero-shot2026.0334.1
EANModel=ERNIE-21B, Pruning Ratio=25%, Protocol=Zero-shot2026.0325.8
SEERModel=ERNIE-21B, Pruning Ratio=25%, Protocol=Zero-shot2026.0325.6
FrequencyModel=ERNIE-21B, Pruning Ratio=25%, Protocol=Zero-shot2026.0325.4
AIMERModel=ERNIE-21B, Pruning Ratio=50%, Protocol=Zero-shot2026.0325.4
MagnitudeModel=ERNIE-21B, Pruning Ratio=50%, Protocol=Zero-shot2026.0324.3
RandomModel=ERNIE-21B, Pruning Ratio=50%, Protocol=Zero-shot2026.0322
REAPModel=ERNIE-21B, Pruning Ratio=25%, Protocol=Zero-shot2026.0320.8
RandomModel=OLMoE-7B, Pruning Ratio=25%, Protocol=Zero-shot2026.0311.2
AIMERModel=OLMoE-7B, Pruning Ratio=25%, Protocol=Zero-shot2026.032.6
REAPModel=ERNIE-21B, Pruning Ratio=50%, Protocol=Zero-shot2026.032.4
REAPModel=OLMoE-7B, Pruning Ratio=25%, Protocol=Zero-shot2026.031.4
EANModel=ERNIE-21B, Pruning Ratio=50%, Protocol=Zero-shot2026.030.9
FrequencyModel=ERNIE-21B, Pruning Ratio=50%, Protocol=Zero-shot2026.030.7
SEERModel=ERNIE-21B, Pruning Ratio=50%, Protocol=Zero-shot2026.030.3
FrequencyModel=OLMoE-7B, Pruning Ratio=25%, Protocol=Zero-shot2026.030
SEERModel=OLMoE-7B, Pruning Ratio=25%, Protocol=Zero-shot2026.030
EANModel=OLMoE-7B, Pruning Ratio=25%, Protocol=Zero-shot2026.030
MagnitudeModel=OLMoE-7B, Pruning Ratio=25%, Protocol=Zero-shot2026.030