List your company
ResearchFormerly WizWand

Code Generation on LCB (Throughput and Acceptance Length)

66.41ThroughputSTAND
15.470828.695441.9255.1446Jun 5, 2025
Updated 5mo ago

Evaluation results

MethodLinks
STANDBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.0666.412.393.01
SAM+RecycleBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.0662.782.262.69
RecycleBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.0660.122.172.73
ANPDBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.0644.791.611.8
PLDBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.0643.41.561.59
SAMBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.0642.921.551.8
STANDBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.0634.8622.93
SAM+RecycleBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.0634.451.982.7
RecycleBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.0633.851.942.71
PlainBackbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.0627.75——
Eagle-2Backbone Model=DeepSeek-R1-Distill-Qwen-7B, Evaluation Pattern=Single-trajectory2025.0627.610.992.13
ANPDBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.0623.161.331.76
SAMBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.0622.361.281.63
Eagle-2Backbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.0621.891.262.51
PLDBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.0621.761.251.58
PlainBackbone Model=DeepSeek-R1-Distill-Qwen-14B, Evaluation Pattern=Single-trajectory2025.0617.43——