List your company

ResearchFormerly WizWand

VerilogEval

Benchmarks

TaskDatasetSOTA resultTrendResults

Verilog Code Generation

VerilogEval v1 (Human)

98.1Pass@1

54

VerilogEval 2.0

84.97Pass@1

40

Verilog Code Generation

VerilogEval Machine

97.9Pass@1

37

Verilog Code Generation

VerilogEval SR v2

83.3Pass@1

34

Verilog Code Generation

VerilogEval CC v2

82.7Pass@1

33

VerilogEval 156 cases (test)

0.78Pass@1

32

Verilog Generation

VerilogEval v2

89.6Pass@1

27

Verilog Code Generation

VerilogEval Machine v1

82.9Pass@1

17

Code Completion

VerilogEval CC v2 (test)

79.1Pass@1

11

Specification-to-RTL

VerilogEval SR v2 (test)

77.5Pass@1

11

Python reference-model generation

VerilogEval v2

82.4Pass@1

10

Verilog Code Generation

VerilogEval 2.0 (test)

82.47Pass@1

10

Verilog Generation

VerilogEval v2 (41 filtered problems)

0.805Solved Rate

8

Hardware Generation

VerilogEval 156 problems

99.4Compilation Rate

5