List your company
ResearchFormerly WizWand

Autoformalization on MiniF2F

100Compilation Pass Rate@10Godel-V2-8B
34.37651.41368.4585.487Aug 9, 2025
Updated 7mo ago

Evaluation results

MethodLinks
Godel-V2-8BAugmentation=+CRAMF2025.081000.4
Godel-V2-8BAugmentation=Base2025.0899.6—
Kimina-7BAugmentation=+CRAMF2025.0899.20.4
Kimina-7BAugmentation=Base2025.0898.8—
Claude 4.1Augmentation=+CRAMF2025.08983
Claude 4.1Augmentation=Base2025.0895.1—
Godel-V2-8BAugmentation=CRAMF2025.0895.17.9
Herald-7BAugmentation=+CRAMF2025.0893.618.3
Claude 4.1Augmentation=CRAMF2025.0892.610.8
Gemini 2.5 FlashAugmentation=+CRAMF2025.0889.38.4
Godel-V2-8BAugmentation=Base2025.0888.1—
Kimina-7BAugmentation=CRAMF2025.0884.85.6
Claude 4.1Augmentation=Base2025.0883.6—
GPT-4oAugmentation=+CRAMF2025.0882.718
Gemini 2.5 FlashAugmentation=Base2025.0882.4—
Gemini 2.5 FlashAugmentation=CRAMF2025.088213.7
Kimina-7BAugmentation=Base2025.0880.3—
Herald-7BAugmentation=Base2025.0879.1—
Gemini 2.5 FlashAugmentation=Base2025.0872.1—
GPT-4oAugmentation=Base2025.0870.1—
Deepseek-V3Augmentation=+CRAMF2025.0869.332.5
Herald-7BAugmentation=CRAMF2025.0863.128.3
GPT-4oAugmentation=CRAMF2025.0860.121.2
Deepseek-V3Augmentation=Base2025.0852.3—
GPT-4oAugmentation=Base2025.0849.6—
Herald-7BAugmentation=Base2025.0849.2—
Deepseek-V3Augmentation=CRAMF2025.0847.127.6
Deepseek-V3Augmentation=Base2025.0836.9—