Multimodal Autoformalization on PHYX Modern
71.4Compile RateGPT-5
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5Modality=Image2026.01 | 71.4 | 71.4 | 42.9 | |
| Gemini-3-ProModality=Text2026.01 | 57.1 | 42.9 | — | |
| GPT-5Modality=Text2026.01 | 37.5 | 12.5 | — | |
| Gemini-3-ProModality=Image2026.01 | 14.3 | 14.3 | 14.3 | |
| Gemini-2.5-ProModality=Image2026.01 | 14.3 | 14.3 | 0 | |
| Gemini-2.5-ProModality=Text2026.01 | 0 | 0 | — | |
| Qwen3-VL-235BModality=Image2026.01 | 0 | 0 | 0 | |
| Qwen3-VL-235BModality=Text2026.01 | 0 | 0 | — | |
| Qwen2.5-VL-72BModality=Image2026.01 | 0 | 0 | 0 | |
| Qwen2.5-VL-72BModality=Text2026.01 | 0 | 0 | — |