Automated Theorem Proving on FVELER (test)
88Solved ProofsFVEL-Llama-3-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| FVEL-Llama-3-8BBackbone=Llama-3-8B, Fine-tuned on FVELER=true, Zero-shot=true, Temperature=0.0, Verification system=PISA2024.06 | 88 | |
| FVEL-Mistral-7BBackbone=Mistral-7B, Fine-tuned on FVELER=true, Zero-shot=true, Temperature=0.0, Verification system=PISA2024.06 | 74 | |
| Llama-3-8BBackbone=Llama-3-8B, Fine-tuned on FVELER=false, Zero-shot=true, Temperature=0.0, Verification system=PISA2024.06 | 39 | |
| Mistral-7BBackbone=Mistral-7B, Fine-tuned on FVELER=false, Zero-shot=true, Temperature=0.0, Verification system=PISA2024.06 | 26 |