Pipelining on RTLOPT 1.0 (test)
0.848AreaHuman
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Humanmode=Standard2026.03 | 0.848 | 45.6 | 0 | |
| GPT-4omode=CODMAS2026.03 | 0.96 | 25.5 | 19.5 | |
| GPT-3.5-turbomode=CODMAS2026.03 | 0.972 | 21.3 | 23.4 | |
| DeepSeek-v2.5mode=CODMAS2026.03 | 0.979 | 21.4 | 22.8 | |
| GPT-4omode=Prompting/Agentic2026.03 | 0.982 | 15.2 | 49.6 | |
| GPT-4omode=Zero-Shot2026.03 | 0.985 | 11.4 | 54.2 | |
| GPT-4omode=LLM-VeriPPA2026.03 | 0.986 | 15.4 | 39.7 | |
| DeepSeek-v2.5mode=Prompting/Agentic2026.03 | 0.986 | 12.8 | 50 | |
| GPT-3.5-turbomode=Prompting/Agentic2026.03 | 0.988 | 14 | 51.2 | |
| GPT-3.5-turbomode=Zero-Shot2026.03 | 0.989 | 10 | 58 | |
| Granite-34bmode=CODMAS2026.03 | 0.998 | 10.5 | 28.3 | |
| GPT-3.5-turbomode=LLM-VeriPPA2026.03 | 1.008 | 13.6 | 43.3 | |
| DeepSeek-v2.5mode=Zero-Shot2026.03 | 1.009 | 9.8 | 57.8 | |
| Granite-34bmode=Prompting/Agentic2026.03 | 1.015 | 5.3 | 59.1 | |
| Granite-34bmode=LLM-VeriPPA2026.03 | 1.022 | 6.6 | 57.7 | |
| DeepSeek-v2.5mode=LLM-VeriPPA2026.03 | 1.025 | 13 | 42.8 | |
| Granite-34bmode=Zero-Shot2026.03 | 1.026 | 3.9 | 65.2 | |
| CodeLlama-34bmode=CODMAS2026.03 | 1.03 | 11.2 | 29.5 | |
| Llama-3mode=CODMAS2026.03 | 1.032 | 19.8 | 25.5 | |
| CodeLlama-34bmode=Zero-Shot2026.03 | 1.035 | 4.2 | 64.7 | |
| CodeLlama-34bmode=Prompting/Agentic2026.03 | 1.036 | 6.8 | 60.7 | |
| CodeLlama-34bmode=LLM-VeriPPA2026.03 | 1.039 | 7.2 | 56.1 | |
| Llama-3mode=Zero-Shot2026.03 | 1.045 | 8.7 | 61.4 | |
| Llama-3mode=LLM-VeriPPA2026.03 | 1.116 | 11.3 | 47.1 | |
| Llama-3mode=Prompting/Agentic2026.03 | 1.181 | 11.6 | 53.8 |