RTLLM
Benchmarks
TaskDatasetSOTA resultTrendResults
RTLLM 2.0
69.17Pass@1
40
RTLLM v1.1
100Syn@5
31
RTLLM v2
75.8Pass@1
27
RTLLM v2.0
84.09Pass@5
17
RTLLM v1
72.9Pass@1
16
Rtllm (test)
42Pass@1
16
RTLLM 50 cases (test)
0.42Pass@1
16
RTLLM v2.0 (test)
76.2Syntax Pass@1
16
RTLLM v2.0
0.07Delay (ns)
15
RTLLM v2
71.8Pass@1
13
RTLLM v2
90Pass@200
12
RTLLM v2 (test)
68Pass@1
11
RTLLM v2
77.3Pass@1
10
RTLLM 2.0 (test)
74.45Pass@1
10
RTLLM v1.1
92Syntax Accuracy
9
RTLLM 50 problems
96Compile Success Rate
5
RTLLM common subset, N=44 and N=49 v2.0
0.48Coverage
4