# Pipelining on RTLOPT 1.0 (test) Source: [Pipelining on RTLOPT 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-03-19T08:12:26.664Z Evaluation of model performance on the Pipelining task using the test split of the RTLOPT 1.0 dataset, measured by Area, Timing, and Failure Rate. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Pipelining | | Dataset (including any stated split) | RTLOPT 1.0 (test) | | Metric | Area | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 25 of 25 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Area](): Lower is better; unit: SCALAR. - [Timing](): Lower is better; unit: TIME. - [Failure Rate](): Lower is better; unit: PERCENT. ## Recorded results | Method | Area | Result date | Report paper | | --- | --- | --- | --- | | Human | 0.848 | Not recorded | 69bb82f30636e5bf4afc1924 | | GPT-4o | 0.96 | Not recorded | 69bb82f30636e5bf4afc1924 | | GPT-3.5-turbo | 0.972 | Not recorded | 69bb82f30636e5bf4afc1924 | | DeepSeek-v2.5 | 0.979 | Not recorded | 69bb82f30636e5bf4afc1924 | | GPT-4o | 0.982 | Not recorded | 69bb82f30636e5bf4afc1924 | | GPT-4o | 0.985 | Not recorded | 69bb82f30636e5bf4afc1924 | | GPT-4o | 0.986 | Not recorded | 69bb82f30636e5bf4afc1924 | | DeepSeek-v2.5 | 0.986 | Not recorded | 69bb82f30636e5bf4afc1924 | | GPT-3.5-turbo | 0.988 | Not recorded | 69bb82f30636e5bf4afc1924 | | GPT-3.5-turbo | 0.989 | Not recorded | 69bb82f30636e5bf4afc1924 | | Granite-34b | 0.998 | Not recorded | 69bb82f30636e5bf4afc1924 | | GPT-3.5-turbo | 1.008 | Not recorded | 69bb82f30636e5bf4afc1924 | | DeepSeek-v2.5 | 1.009 | Not recorded | 69bb82f30636e5bf4afc1924 | | Granite-34b | 1.015 | Not recorded | 69bb82f30636e5bf4afc1924 | | Granite-34b | 1.022 | Not recorded | 69bb82f30636e5bf4afc1924 | | DeepSeek-v2.5 | 1.025 | Not recorded | 69bb82f30636e5bf4afc1924 | | Granite-34b | 1.026 | Not recorded | 69bb82f30636e5bf4afc1924 | | CodeLlama-34b | 1.03 | Not recorded | 69bb82f30636e5bf4afc1924 | | Llama-3 | 1.032 | Not recorded | 69bb82f30636e5bf4afc1924 | | CodeLlama-34b | 1.035 | Not recorded | 69bb82f30636e5bf4afc1924 | | CodeLlama-34b | 1.036 | Not recorded | 69bb82f30636e5bf4afc1924 | | CodeLlama-34b | 1.039 | Not recorded | 69bb82f30636e5bf4afc1924 | | Llama-3 | 1.045 | Not recorded | 69bb82f30636e5bf4afc1924 | | Llama-3 | 1.116 | Not recorded | 69bb82f30636e5bf4afc1924 | | Llama-3 | 1.181 | Not recorded | 69bb82f30636e5bf4afc1924 | ### Human Area: 0.848. Result ID: 69bbaf9847f34ce924a569f5. [Reporting paper]() Recorded evaluation configuration: {"mode":"Standard"}. This record does not assert independent reproduction. ### GPT-4o Area: 0.96. Result ID: 69bbaf9847f34ce924a569e0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"CODMAS"}. This record does not assert independent reproduction. ### GPT-3.5-turbo Area: 0.972. Result ID: 69bbaf9847f34ce924a569e4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"CODMAS"}. This record does not assert independent reproduction. ### DeepSeek-v2.5 Area: 0.979. Result ID: 69bbaf9847f34ce924a569e8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"CODMAS"}. This record does not assert independent reproduction. ### GPT-4o Area: 0.982. Result ID: 69bbaf9847f34ce924a569de. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Prompting/Agentic"}. This record does not assert independent reproduction. ### GPT-4o Area: 0.985. Result ID: 69bbaf9847f34ce924a569dd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Zero-Shot"}. This record does not assert independent reproduction. ### GPT-4o Area: 0.986. Result ID: 69bbaf9847f34ce924a569df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"LLM-VeriPPA"}. This record does not assert independent reproduction. ### DeepSeek-v2.5 Area: 0.986. Result ID: 69bbaf9847f34ce924a569e6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Prompting/Agentic"}. This record does not assert independent reproduction. ### GPT-3.5-turbo Area: 0.988. Result ID: 69bbaf9847f34ce924a569e2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Prompting/Agentic"}. This record does not assert independent reproduction. ### GPT-3.5-turbo Area: 0.989. Result ID: 69bbaf9847f34ce924a569e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Zero-Shot"}. This record does not assert independent reproduction. ### Granite-34b Area: 0.998. Result ID: 69bbaf9847f34ce924a569f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"CODMAS"}. This record does not assert independent reproduction. ### GPT-3.5-turbo Area: 1.008. Result ID: 69bbaf9847f34ce924a569e3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"LLM-VeriPPA"}. This record does not assert independent reproduction. ### DeepSeek-v2.5 Area: 1.009. Result ID: 69bbaf9847f34ce924a569e5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Zero-Shot"}. This record does not assert independent reproduction. ### Granite-34b Area: 1.015. Result ID: 69bbaf9847f34ce924a569ee. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Prompting/Agentic"}. This record does not assert independent reproduction. ### Granite-34b Area: 1.022. Result ID: 69bbaf9847f34ce924a569ef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"LLM-VeriPPA"}. This record does not assert independent reproduction. ### DeepSeek-v2.5 Area: 1.025. Result ID: 69bbaf9847f34ce924a569e7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"LLM-VeriPPA"}. This record does not assert independent reproduction. ### Granite-34b Area: 1.026. Result ID: 69bbaf9847f34ce924a569ed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Zero-Shot"}. This record does not assert independent reproduction. ### CodeLlama-34b Area: 1.03. Result ID: 69bbaf9847f34ce924a569f4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"CODMAS"}. This record does not assert independent reproduction. ### Llama-3 Area: 1.032. Result ID: 69bbaf9847f34ce924a569ec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"CODMAS"}. This record does not assert independent reproduction. ### CodeLlama-34b Area: 1.035. Result ID: 69bbaf9847f34ce924a569f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Zero-Shot"}. This record does not assert independent reproduction. ### CodeLlama-34b Area: 1.036. Result ID: 69bbaf9847f34ce924a569f2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Prompting/Agentic"}. This record does not assert independent reproduction. ### CodeLlama-34b Area: 1.039. Result ID: 69bbaf9847f34ce924a569f3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"LLM-VeriPPA"}. This record does not assert independent reproduction. ### Llama-3 Area: 1.045. Result ID: 69bbaf9847f34ce924a569e9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Zero-Shot"}. This record does not assert independent reproduction. ### Llama-3 Area: 1.116. Result ID: 69bbaf9847f34ce924a569eb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"LLM-VeriPPA"}. This record does not assert independent reproduction. ### Llama-3 Area: 1.181. Result ID: 69bbaf9847f34ce924a569ea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Prompting/Agentic"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.