Formal Verification on Code2Inv (#=133) (test)
107Solved TasksLemur-GPT-4
Evaluation results
| Method | Links | |
|---|---|---|
| Lemur-GPT-4Solver Category=LLM-based Solver2024.06 | 107 | |
| Lemur-GPT-3.5-turboSolver Category=LLM-based Solver2024.06 | 103 | |
| UAUTOMIZERSolver Category=Symbolic Solver2024.06 | 92 | |
| ESBMCSolver Category=Symbolic Solver2024.06 | 68 | |
| Llama3-8BSolver Category=LLM-based Solver2024.06 | 46 | |
| Llama3-8B-FTSolver Category=LLM-based Solver, Fine-tuned=true2024.06 | 46 | |
| Mistral-7B-FTSolver Category=LLM-based Solver, Fine-tuned=true2024.06 | 40 | |
| Mistral-7BSolver Category=LLM-based Solver2024.06 | 37 |