List your company

Verilog generation on CVDP cid03

44Pass@1 RateGPT-5.5
10.51219.20627.936.594May 13, 2026

Evaluation results

MethodLinks
GPT-5.5Type=Foundation Models2026.054448.7
Claude Opus 4.7Type=Foundation Models2026.0542.847.9
ChipMATE-Agents-9BType=ChipMATE (Ours), Size=9B2026.0540.444.6
GPT-4oType=Foundation Models2026.053940.4
ChipMATE-Agents-4BType=ChipMATE (Ours), Size=4B2026.0532.141.3
ChipMATE-Verilog-9BType=ChipMATE (Ours), Size=9B2026.0528.142.1
DeepSeek R1Type=Foundation Models, Size=671B2026.0527.742.1
CodeV-R1Type=Specialized Models, Size=7B2026.0526.843.3
CodeV-R1 (distill)Type=Specialized Models, Size=7B2026.0526.242.1
ChipMATE-Verilog-4BType=ChipMATE (Ours), Size=4B2026.0524.739.2
DeepSeek CoderType=Foundation Models, Size=236B2026.0522.337.2
DeepSeek V4Type=Foundation Models, Size=1.6T2026.0521.534.6
Qwen3.5-9BType=Base Models, Size=9B2026.0513.321.5
Qwen3.5-4BType=Base Models, Size=4B2026.0511.813.9