List your company
ResearchFormerly WizWand

Verilog Code Generation on VerilogEval SR v2

83.3Pass@1Deepseek-R1-671B
19.54836.09952.6569.201Nov 25, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Deepseek-R1-671BSetting=T=02025.1183.3
Deepseek-R1-671BSetting=T=0.82025.1179.8
Deepseek-R1-671BSetting=T-cross2025.1177.5
Deepseek-V3-671BSetting=T=02025.1168.8
CodeV-R1-7BSetting=T-cross2025.1168.8
Deepseek-V3-671BSetting=T=0.82025.1166.9
CodeV-R1-Distill-7BSetting=T-cross2025.1165.2
QiMeng-CRUX-Final-7BSetting=T=02025.1164.7
QiMeng-CRUX-Final-7BSetting=T=0.82025.1164.4
QiMeng-CRUX-Final-7BSetting=T-cross2025.1164.2
GPT-4oSetting=T-cross2025.1164.1
GPT-4oSetting=T=02025.1162.5
Deepseek-V3-671BSetting=T-cross2025.1162.4
GPT-4oSetting=T=0.82025.1161.4
QiMeng-CRUX-SFT-7BSetting=T-cross2025.1161.1
QiMeng-CRUX-SFT-7BSetting=T=02025.1159.6
QiMeng-CRUX-SFT-7BSetting=T=0.82025.1157
HaVen-7BSetting=T-cross2025.1154.6
OriGen-7BSetting=T=02025.1149.3
Qwen2.5-Coder-32BSetting=T-cross2025.1147.5
Qwen2.5-Coder-32BSetting=T=02025.1146.8
OriGen-7BSetting=T=0.82025.1146.8
CodeV-Qwen2.5-7BSetting=T=02025.1144.8
CodeV-Qwen2.5-7BSetting=T-cross2025.1142.2
Qwen2.5-Coder-32BSetting=T=0.82025.1141.6
CodeV-Qwen2.5-7BSetting=T=0.82025.1137.4
Deepseek-Coder-6.7BSetting=T=02025.1136.8
RTLCoder-6.7BSetting=T=02025.1136.8
Qwen2.5-Coder-7BSetting=T-cross2025.1131.3
RTLCoder-6.7BSetting=T-cross2025.1131.1
Deepseek-Coder-6.7BSetting=T=0.82025.1130.9
RTLCoder-6.7BSetting=T=0.82025.1130.9
Qwen2.5-Coder-7BSetting=T=02025.1123
Qwen2.5-Coder-7BSetting=T=0.82025.1122