Multi-digit Multiplication on HDS alphabetic 1.0 (test)
11.217Beta 0openai-gpt-5.4
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| openai-gpt-5.4Modality=alphabetic2026.04 | 11.217 | -0.1651 | 67.9324 | 65.65 | |
| openai-gpt-4oModality=alphabetic2026.04 | 8.5268 | -0.1611 | 52.9296 | 68.83 | |
| x-ai-grok-4.20Modality=alphabetic2026.04 | 8.0283 | -0.123 | 65.2729 | 50.24 | |
| qwen-qwen3-vl-235b-a22b-instructModality=alphabetic2026.04 | 7.0143 | -0.0942 | 74.454 | 36.93 | |
| google-gemini-2.5-flashModality=alphabetic2026.04 | 6.8299 | -0.1299 | 52.571 | 59.44 | |
| qwen-qwen3-vl-30b-a3b-instructModality=alphabetic2026.04 | 6.3232 | -0.1273 | 49.6883 | 56.04 |