List your company
ResearchFormerly WizWand

Lemma Discovery on Octonions Isabelle/AFP 2026 context (test)

0.766Lemma Discovery RateLEMMANAID DeepSeek-coder-6.7B
0.426960.514980.6030.69102Apr 7, 2025
Updated 5mo ago

Evaluation results

MethodLinks
LEMMANAID DeepSeek-coder-6.7BStrategy=Template, Backbone=DeepSeek-coder-6.7B, Evaluation=Fine-tuned, Prompting=types+defs, Predictions=1 greedy, 4 beam-search2025.040.766
LEMMANAID DeepSeek-coder-1.3BStrategy=Template, Backbone=DeepSeek-coder-1.3B, Evaluation=Fine-tuned, Prompting=types+defs, Predictions=1 greedy, 4 beam-search2025.040.669
Neural DeepSeek-coder-6.7BStrategy=Lemma-object, Backbone=DeepSeek-coder-6.7B, Evaluation=Fine-tuned, Prompting=types+defs, Predictions=1 greedy, 4 beam-search2025.040.617
Neural Llama-3.2-1BStrategy=Lemma-object, Backbone=Llama-3.2-1B, Evaluation=Fine-tuned, Prompting=types+defs, Predictions=1 greedy, 4 beam-search2025.040.546
GPT-5.2Strategy=Template, Evaluation=Few-shot, Prompting=5 few-shot examples, Predictions=1 greedy, 4 temperature-1 samples2025.040.5
Claude Opus 4.5Strategy=Template, Evaluation=Few-shot, Prompting=5 few-shot examples, Predictions=1 greedy, 4 temperature-1 samples2025.040.471
LEMMANAID Llama-3.2-1BStrategy=Template, Backbone=Llama-3.2-1B, Evaluation=Fine-tuned, Prompting=types+defs, Predictions=1 greedy, 4 beam-search2025.040.469
Claude Opus 4.5Strategy=Lemma-object, Evaluation=Few-shot, Prompting=5 few-shot examples, Predictions=1 greedy, 4 temperature-1 samples2025.040.463
GPT-5.2Strategy=Lemma-object, Evaluation=Few-shot, Prompting=5 few-shot examples, Predictions=1 greedy, 4 temperature-1 samples2025.040.454
Neural DeepSeek-coder-1.3BStrategy=Lemma-object, Backbone=DeepSeek-coder-1.3B, Evaluation=Fine-tuned, Prompting=types+defs, Predictions=1 greedy, 4 beam-search2025.040.44