List your company
ResearchFormerly WizWand

Code Generation on MBPP (Accuracy, TPF, TPS, Speedup)

284TPFJacobi Forcing Model (MR)
92.64142.32192241.68Dec 16, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Jacobi Forcing Model (MR)Family=AR-based, Backbone=Qwen2.5-Coder-7B-Instruct, Multi-block and rejection-recycling=true2025.122841132.6270.4
Jacobi Forcing ModelFamily=AR-based, Backbone=Qwen2.5-Coder-7B-Instruct2025.12274110.72.5770.4
D2FFamily=Diffusion-based, Backbone=Dream-7B2025.122301052.4455.2
CLLM*Family=AR-based, Backbone=Qwen2.5-Coder-7B-Instruct, sequence packing=new sequence packing technique2025.1221080.11.9471.4
Fast-dLLM (DC)Family=Diffusion-based, Backbone=Dream-7B, bi-directional dual cache=true2025.1219073.21.751
JacobiFamily=AR-based, Backbone=Qwen2.5-Coder-7B-Instruct2025.1210142.40.9874.3
ARFamily=AR-based, Backbone=Qwen2.5-Coder-7B-Instruct2025.1210043.1174.3
LLaDA-InstructFamily=Diffusion-based, Backbone=LLaDA-7B2025.121000.90.0239
Dream-BaseFamily=Diffusion-based, Backbone=Dream-7B2025.1210010.40.2456.2