Formal Verification on CIC Decimator
37Assertion CountSaarthi
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SaarthiBackbone=GPT-5, Pass level=Pass@22026.03 | 37 | — | 1 | 91.89 | 77.39 | |
| SaarthiBackbone=GPT-5, Pass level=Pass@12026.03 | 36 | — | 0 | 75 | 74.45 | |
| SaarthiBackbone=GPT-5, Pass level=Pass@32026.03 | 30 | — | 0 | 86.67 | 72.86 | |
| SaarthiBackbone=GPT-4.1, Pass level=Pass@32026.03 | 19 | — | 0 | 52.63 | 56.67 | |
| SaarthiBackbone=GPT-4.1, Pass level=Pass@12026.03 | 16 | — | 0 | 62.5 | 66.67 | |
| SaarthiBackbone=GPT-4.1, Pass level=Pass@22026.03 | 16 | — | 0 | 31.25 | 52.14 | |
| SaarthiBackbone=Llama3.3, Pass level=Pass@12026.03 | 10 | — | 1 | 40 | 50 | |
| SaarthiBackbone=Llama3.3, Pass level=Pass@22026.03 | 10 | — | 0 | 30 | 18.22 | |
| SaarthiBackbone=Llama3.3, Pass level=Pass@32026.03 | 10 | — | 1 | 30 | 48.42 |