List your company
ResearchFormerly WizWand

Lemma Discovery on AFP Recent formalizations (Swap Distance, Linear Orders) 2026 (test)

41.7Lemma Discovery RateLEMMANAID DeepSeek-coder-6.7B
14.76421.75728.7535.743Apr 7, 2025
Updated 5mo ago

Evaluation results

MethodLinks
LEMMANAID DeepSeek-coder-6.7BStrategy=Template, Backbone=DeepSeek-coder-6.7B, Evaluation=Fine-tuned2025.0441.7
Neural DeepSeek-coder-6.7BStrategy=Lemma-object, Backbone=DeepSeek-coder-6.7B, Evaluation=Fine-tuned2025.0438.1
Claude Opus 4.5Strategy=Lemma-object, Evaluation=Few-shot2025.0434.5
LEMMANAID DeepSeek-coder-1.3BStrategy=Template, Backbone=DeepSeek-coder-1.3B, Evaluation=Fine-tuned2025.0430.9
LEMMANAID Llama-3.2-1BStrategy=Template, Backbone=Llama-3.2-1B, Evaluation=Fine-tuned2025.0428.1
Neural DeepSeek-coder-1.3BStrategy=Lemma-object, Backbone=DeepSeek-coder-1.3B, Evaluation=Fine-tuned2025.0425.2
GPT-5.2Strategy=Lemma-object, Evaluation=Few-shot2025.0425.2
Neural Llama-3.2-1BStrategy=Lemma-object, Backbone=Llama-3.2-1B, Evaluation=Fine-tuned2025.0423
Claude Opus 4.5Strategy=Template, Evaluation=Few-shot2025.0419.4
GPT-5.2Strategy=Template, Evaluation=Few-shot2025.0415.8