SVA Generation on FVEval Design2SVA Pipeline Designs
41.2Func@1ProofLoop
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ProofLoopBackbone=Qwen3.5-35B2026.04 | 41.2 | 89.6 | |
| Gemini-1.5-Pro2026.04 | 17.5 | 50 | |
| Llama-3.1-70B2026.04 | 16.7 | 61.5 | |
| Llama-3.1-8B2026.04 | 15 | 55.2 | |
| Mixtral-8x22B2026.04 | 11.9 | 47.2 | |
| GPT-4o2026.04 | 10.4 | 42.7 | |
| Gemini-1.5-Flash2026.04 | 2.5 | 12.5 |