Formal Verification on Automotive IP
76Assertion CountSaarthi
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SaarthiBackbone=GPT-5, Pass level=Pass@22026.03 | 76 | — | 3 | 56.57 | 77.02 | |
| SaarthiBackbone=GPT-4.1, Pass level=Pass@22026.03 | 64 | — | 5 | 50 | 76.6 | |
| SaarthiBackbone=GPT-5, Pass level=Pass@12026.03 | 58 | — | 3 | 84.48 | 80.99 | |
| SaarthiBackbone=GPT-5, Pass level=Pass@32026.03 | 54 | — | 3 | 55.55 | 80.38 | |
| SaarthiBackbone=GPT-4.1, Pass level=Pass@32026.03 | 45 | — | 3 | 48.88 | 72.75 | |
| SaarthiBackbone=GPT-4.1, Pass level=Pass@12026.03 | 36 | — | 4 | 50 | 64.29 | |
| SaarthiBackbone=Llama3.3, Pass level=Pass@22026.03 | 16 | — | 5 | 18.75 | 8.96 | |
| SaarthiBackbone=Llama3.3, Pass level=Pass@32026.03 | 11 | — | 5 | 45.45 | 42.44 | |
| SaarthiBackbone=Llama3.3, Pass level=Pass@12026.03 | 9 | — | 5 | 22.22 | 6.99 |