Automated Theorem Proving on FVELER hard (test)
64Solved ProofsFVEL-Llama-3-8B
Evaluation results
| Method | Links | |
|---|---|---|
| FVEL-Llama-3-8BBackbone=Llama-3-8B, Fine-tuned on FVELER=true, Zero-shot=true, Temperature=0.0, Verification system=PISA2024.06 | 64 | |
| FVEL-Mistral-7BBackbone=Mistral-7B, Fine-tuned on FVELER=true, Zero-shot=true, Temperature=0.0, Verification system=PISA2024.06 | 49 | |
| Llama-3-8BBackbone=Llama-3-8B, Fine-tuned on FVELER=false, Zero-shot=true, Temperature=0.0, Verification system=PISA2024.06 | 27 | |
| Mistral-7BBackbone=Mistral-7B, Fine-tuned on FVELER=false, Zero-shot=true, Temperature=0.0, Verification system=PISA2024.06 | 19 |