Formal Verification on SV-COMP (#=47)
25Solved TasksLemur-GPT-4
Evaluation results
| Method | Links | |
|---|---|---|
| Lemur-GPT-4Solver Category=LLM-based Solver2024.06 | 25 | |
| Llama3-8B-FTSolver Category=LLM-based Solver, Fine-tuned=true2024.06 | 16 | |
| Lemur-GPT-3.5-turboSolver Category=LLM-based Solver2024.06 | 14 | |
| Mistral-7B-FTSolver Category=LLM-based Solver, Fine-tuned=true2024.06 | 14 | |
| Llama3-8BSolver Category=LLM-based Solver2024.06 | 11 | |
| Mistral-7BSolver Category=LLM-based Solver2024.06 | 10 | |
| UAUTOMIZERSolver Category=Symbolic Solver2024.06 | 1 | |
| ESBMCSolver Category=Symbolic Solver2024.06 | 1 |