Educational Animation Generation on EduRequire-500
90.7R@1OmniManim
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OmniManimBase language model=GPT-5.42026.05 | 90.7 | 98.6 | 83.6 | 73 | 86.8 | 76.3 | 93.1 | 80.2 | 76.2 | 73,279 | 72 | |
| OmniManimBase language model=Gemini 3.1 Pro Preview2026.05 | 88.4 | 97.2 | 85.2 | 74.8 | 85.2 | 77.8 | 94.2 | 81.8 | 78.1 | 74,800 | 78 | |
| Code2VideoBase language model=GPT-5.42026.05 | 84.1 | 92.3 | 72.4 | 71.2 | 54.1 | 59.8 | 74.2 | 78.4 | 74.8 | 69,532 | 148 | |
| GPT-5.42026.05 | 81.2 | 93.4 | 61.2 | 64.2 | 59.7 | 62.8 | 77.8 | 76.4 | 74.8 | 56,328 | 108 | |
| Code2VideoBase language model=Gemini 3.1 Pro Preview2026.05 | 81.2 | 90.1 | 74.8 | 73.4 | 55.8 | 58.4 | 75.8 | 76.4 | 78.2 | 68,200 | 142 | |
| Gemini 3.1 Pro Preview2026.05 | 79.6 | 91.8 | 58.4 | 59.8 | 55.1 | 57.8 | 76.8 | 74.2 | 78.2 | 64,215 | 133 | |
| Kimi K2.52026.05 | 76.1 | 89.2 | 54.8 | 57.1 | 52.8 | 51.2 | 80.8 | 79.8 | 76.8 | 51,234 | 109 | |
| MiniMax-M2.72026.05 | 71.8 | 85.6 | 51.2 | 55.2 | 50.8 | 45.8 | 62.8 | 61.8 | 65.8 | 47,186 | 116 | |
| Qwen3-14B2026.05 | 17.4 | 35.6 | 29.6 | 18.4 | 15.1 | 10.8 | 16.4 | 17.2 | 20.4 | 28,714 | 56 |