Formal Verification on ECC
48Assertion CountSaarthi
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SaarthiBackbone=GPT-5, Pass level=Pass@32026.03 | 48 | — | 0 | 81.25 | 93.74 | |
| SaarthiBackbone=GPT-5, Pass level=Pass@22026.03 | 32 | — | 0 | 75 | 61.86 | |
| SaarthiBackbone=GPT-5, Pass level=Pass@12026.03 | 28 | — | 0 | 89.28 | 58.57 | |
| SaarthiBackbone=GPT-4.1, Pass level=Pass@22026.03 | 25 | — | 0 | 64 | 60.21 | |
| SaarthiBackbone=GPT-4.1, Pass level=Pass@32026.03 | 25 | — | 2 | 64 | 58.15 | |
| SaarthiBackbone=GPT-4.1, Pass level=Pass@12026.03 | 19 | — | 1 | 71.86 | 62.67 | |
| SaarthiBackbone=Llama3.3, Pass level=Pass@12026.03 | 14 | — | 2 | 57.14 | 68.01 | |
| SaarthiBackbone=Llama3.3, Pass level=Pass@32026.03 | 12 | — | 0 | 50 | 43.9 | |
| SaarthiBackbone=Llama3.3, Pass level=Pass@22026.03 | 6 | — | 0 | 33.33 | 2.18 |