List your company
ResearchFormerly WizWand

Verilog Code Generation on VerilogEval CC v2

82.7Pass@1Deepseek-R1-671B
18.53235.19151.8568.509Nov 25, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Deepseek-R1-671BSetting=T=02025.1182.7
Deepseek-R1-671BSetting=T=0.82025.1181
Deepseek-R1-671BSetting=T-cross2025.1179.1
CodeV-R1-7BSetting=T-cross2025.1169.9
Deepseek-V3-671BSetting=T-cross2025.1168.7
Deepseek-V3-671BSetting=T=02025.1168
QiMeng-CRUX-Final-7BSetting=T=02025.1168
QiMeng-CRUX-Final-7BSetting=T-cross2025.1167.6
QiMeng-CRUX-Final-7BSetting=T=0.82025.1166.7
Deepseek-V3-671BSetting=T=0.82025.1166.1
CodeV-R1-Distill-7BSetting=T-cross2025.1165.6
QiMeng-CRUX-SFT-7BSetting=T-cross2025.1165.5
QiMeng-CRUX-SFT-7BSetting=T=02025.1164.7
CodeV-Qwen2.5-7BSetting=T-cross2025.1160.4
GPT-4oSetting=T=02025.1159
QiMeng-CRUX-SFT-7BSetting=T=0.82025.1158.9
CodeV-Qwen2.5-7BSetting=T=02025.1158.3
GPT-4oSetting=T-cross2025.1157.6
GPT-4oSetting=T=0.82025.1156.1
CodeV-Qwen2.5-7BSetting=T=0.82025.1149.9
OriGen-7BSetting=T=02025.1149.3
OriGen-7BSetting=T=0.82025.1147.2
Qwen2.5-Coder-32BSetting=T-cross2025.1146.6
Qwen2.5-Coder-32BSetting=T=02025.1144.2
Qwen2.5-Coder-32BSetting=T=0.82025.1141.5
RTLCoder-6.7BSetting=T=02025.1135.9
RTLCoder-6.7BSetting=T-cross2025.1133.7
RTLCoder-6.7BSetting=T=0.82025.1131.5
Qwen2.5-Coder-7BSetting=T-cross2025.1130.5
Qwen2.5-Coder-7BSetting=T=02025.1130.1
Qwen2.5-Coder-7BSetting=T=0.82025.1125.6
Deepseek-Coder-6.7BSetting=T=02025.1124.4
Deepseek-Coder-6.7BSetting=T=0.82025.1121