List your company
ResearchFormerly WizWand

Autoformalization on AdvancedMath

100Compilation Pass Rate@10Kimina-7B
16.59238.24659.981.554Aug 9, 2025
Updated 7mo ago

Evaluation results

MethodLinks
Kimina-7BAugmentation=+CRAMF2025.081001.2
Godel-V2-8BAugmentation=+CRAMF2025.081001.2
Claude 4.1Augmentation=+CRAMF2025.0899.40.6
Claude 4.1Augmentation=Base2025.0898.8—
Kimina-7BAugmentation=Base2025.0898.8—
Godel-V2-8BAugmentation=Base2025.0898.8—
Herald-7BAugmentation=+CRAMF2025.0890.212.8
Gemini 2.5 FlashAugmentation=+CRAMF2025.0882.13.5
Herald-7BAugmentation=Base2025.0880—
Gemini 2.5 FlashAugmentation=Base2025.0879.3—
Godel-V2-8BAugmentation=CRAMF2025.0868.218
Kimina-7BAugmentation=CRAMF2025.0866.58.5
Claude 4.1Augmentation=CRAMF2025.0865.915.2
Kimina-7BAugmentation=Base2025.0861.3—
GPT-4oAugmentation=+CRAMF2025.0859.121.9
Godel-V2-8BAugmentation=Base2025.0857.8—
Claude 4.1Augmentation=Base2025.0857.2—
Herald-7BAugmentation=CRAMF2025.0851.430.8
Gemini 2.5 FlashAugmentation=CRAMF2025.0850.915.9
GPT-4oAugmentation=Base2025.0848.5—
Deepseek-V3Augmentation=+CRAMF2025.0848.252.1
Gemini 2.5 FlashAugmentation=Base2025.0843.9—
Herald-7BAugmentation=Base2025.0839.3—
GPT-4oAugmentation=CRAMF2025.0834.752.2
Deepseek-V3Augmentation=CRAMF2025.0832.162.1
Deepseek-V3Augmentation=Base2025.0831.7—
GPT-4oAugmentation=Base2025.0822.8—
Deepseek-V3Augmentation=Base2025.0819.8—