List your company

Verilog generation on ChipBench-SC

36.7Pass@1ChipMATE-Agents-9B
5.513.621.729.8May 13, 2026

Evaluation results

MethodLinks
ChipMATE-Agents-9BType=ChipMATE (Ours), Size=9B2026.0536.743.3
ChipMATE-Agents-4BType=ChipMATE (Ours), Size=4B2026.0533.343.3
Claude Opus 4.7Type=Foundation Models2026.0531.346.7
GPT-5.5Type=Foundation Models2026.0530.736.7
CodeV-R1Type=Specialized Models, Size=7B2026.053040
ChipMATE-Verilog-9BType=ChipMATE (Ours), Size=9B2026.053036.7
DeepSeek R1Type=Foundation Models, Size=671B2026.0526.740
ChipMATE-Verilog-4BType=ChipMATE (Ours), Size=4B2026.0526.733.3
GPT-4oType=Foundation Models2026.052033.3
DeepSeek V4Type=Foundation Models, Size=1.6T2026.051836.7
DeepSeek CoderType=Foundation Models, Size=236B2026.0516.730
CodeV-R1 (distill)Type=Specialized Models, Size=7B2026.0513.326.7
Qwen3.5-9BType=Base Models, Size=9B2026.0513.320
Qwen3.5-4BType=Base Models, Size=4B2026.056.710