List your company
ResearchFormerly WizWand

Code Generation on Coding

56.1Pass@1TRACELOCK
2.85216.67630.544.324May 23, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TRACELOCKModel=Dream, Gen len=256, Win./Block=64, Avg. step=79.92026.0556.1
TRACELOCKModel=Dream, Gen len=256, Win./Block=128, Avg. step=80.92026.0556.1
Fast-dLLMModel=Dream, Gen len=256, Win./Block=64, Avg. step=195.42026.0553
ConfidenceModel=Dream, Gen len=256, Win./Block=64, Avg. step=256.02026.0552.4
TRACELOCKModel=Dream, Gen len=128, Win./Block=32, Avg. step=47.92026.0551.2
TRACELOCKModel=Dream, Gen len=128, Win./Block=64, Avg. step=47.72026.0551.2
L2PModel=Dream, Gen len=128, Win./Block=32, Avg. step=106.62026.0548.8
ConfidenceModel=Dream, Gen len=128, Win./Block=64, Avg. step=128.02026.0548.8
Fast-dLLMModel=Dream, Gen len=128, Win./Block=64, Avg. step=77.92026.0547.6
ConfidenceModel=Dream, Gen len=128, Win./Block=32, Avg. step=128.02026.0547
Fast-dLLMModel=Dream, Gen len=128, Win./Block=32, Avg. step=100.62026.0545.7
Fast-dLLMModel=Dream, Gen len=256, Win./Block=128, Avg. step=134.72026.0545.1
ConfidenceModel=Dream, Gen len=256, Win./Block=128, Avg. step=256.02026.0544.5
TRACELOCKModel=LLaDA, Gen len=256, Win./Block=64, Avg. step=86.82026.0537.2
ConfidenceModel=LLaDA, Gen len=256, Win./Block=64, Avg. step=256.02026.0536
Fast-dLLMModel=LLaDA, Gen len=256, Win./Block=64, Avg. step=44.92026.0535.4
TRACELOCKModel=LLaDA, Gen len=256, Win./Block=128, Avg. step=95.72026.0535.4
ConfidenceModel=LLaDA, Gen len=256, Win./Block=128, Avg. step=256.02026.0534.1
Fast-dLLMModel=LLaDA, Gen len=256, Win./Block=128, Avg. step=43.22026.0534.1
L2PModel=Dream, Gen len=128, Win./Block=64, Avg. step=91.02026.0532.9
TRACELOCKModel=LLaDA, Gen len=128, Win./Block=32, Avg. step=55.52026.0532.3
L2PModel=LLaDA, Gen len=256, Win./Block=64, Avg. step=35.22026.0532.3
TRACELOCKModel=LLaDA, Gen len=128, Win./Block=64, Avg. step=59.22026.0531.7
L2PModel=Dream, Gen len=256, Win./Block=64, Avg. step=197.52026.0531.7
ConfidenceModel=LLaDA, Gen len=128, Win./Block=32, Avg. step=128.02026.0531.1
ConfidenceModel=LLaDA, Gen len=128, Win./Block=64, Avg. step=128.02026.0531.1
Fast-dLLMModel=LLaDA, Gen len=128, Win./Block=32, Avg. step=33.52026.0529.9
L2PModel=LLaDA, Gen len=128, Win./Block=32, Avg. step=29.22026.0528.7
Fast-dLLMModel=LLaDA, Gen len=128, Win./Block=64, Avg. step=33.22026.0528.7
L2PModel=LLaDA, Gen len=128, Win./Block=64, Avg. step=28.02026.0524.4
RandomModel=Dream, Gen len=128, Win./Block=32, Avg. step=128.02026.0522.6
L2PModel=LLaDA, Gen len=256, Win./Block=128, Avg. step=37.12026.0520.1
RandomModel=Dream, Gen len=128, Win./Block=64, Avg. step=128.02026.0519.5
RandomModel=LLaDA, Gen len=256, Win./Block=64, Avg. step=256.02026.0515.2
RandomModel=LLaDA, Gen len=256, Win./Block=128, Avg. step=256.02026.0515.2
RandomModel=Dream, Gen len=256, Win./Block=128, Avg. step=256.02026.0515.2
RandomModel=LLaDA, Gen len=128, Win./Block=32, Avg. step=128.02026.0514
RandomModel=Dream, Gen len=256, Win./Block=64, Avg. step=256.02026.0513.4
RandomModel=LLaDA, Gen len=128, Win./Block=64, Avg. step=128.02026.0511.6
L2PModel=Dream, Gen len=256, Win./Block=128, Avg. step=131.02026.054.9