STEM Reasoning on LogicVista
70.02AccuracyCodePercept-32B-S1
Evaluation results
| Method | Links | |
|---|---|---|
| CodePercept-32B-S1LLM Solver=Qwen3-235A22-Thinking2026.03 | 70.02 | |
| Gemini2.5-ProLLM Solver=Qwen3-30A3-Thinking2026.03 | 66.44 | |
| Qwen3-VL-32B-InstructLLM Solver=Qwen3-235A22-Thinking2026.03 | 66.44 | |
| CodePercept-32B-S1LLM Solver=Qwen3-30A3-Thinking2026.03 | 65.33 | |
| CodePercept-4B-S1LLM Solver=Qwen3-235A22-Thinking2026.03 | 64.65 | |
| CodePercept-8B-S1LLM Solver=Qwen3-235A22-Thinking2026.03 | 62.64 | |
| Qwen3-VL-32B-InstructLLM Solver=Qwen3-30A3-Thinking2026.03 | 62.19 | |
| CodePercept-8B-S1LLM Solver=Qwen3-30A3-Thinking2026.03 | 61.52 | |
| CodePercept-4B-S1LLM Solver=Qwen3-30A3-Thinking2026.03 | 60.4 | |
| Qwen3-VL-235A22B-InstructLLM Solver=Qwen3-30A3-Thinking2026.03 | 59.73 | |
| Claude-Opus 4.1-ThinkingLLM Solver=Qwen3-30A3-Thinking2026.03 | 59.28 | |
| Qwen3-VL-8B-InstructLLM Solver=Qwen3-235A22-Thinking2026.03 | 58.16 | |
| Qwen3-VL-8B-InstructLLM Solver=Qwen3-30A3-Thinking2026.03 | 56.82 | |
| Qwen3-VL-4B-InstructLLM Solver=Qwen3-235A22-Thinking2026.03 | 56.82 | |
| Qwen3-VL-4B-InstructLLM Solver=Qwen3-30A3-Thinking2026.03 | 54.14 | |
| Qwen3-VL-30A3B-InstructLLM Solver=Qwen3-30A3-Thinking2026.03 | 53.69 | |
| GPT5-ThinkingLLM Solver=Qwen3-30A3-Thinking2026.03 | 53.02 | |
| MiniCPM-V-4.5LLM Solver=Qwen3-30A3-Thinking2026.03 | 52.57 | |
| Qwen2.5-VL-72BLLM Solver=Qwen3-30A3-Thinking2026.03 | 52.34 | |
| InternVL3.5-8BLLM Solver=Qwen3-30A3-Thinking2026.03 | 51.68 | |
| Intern-S1-8BLLM Solver=Qwen3-30A3-Thinking2026.03 | 51.23 | |
| GLM-4.1V-9BLLM Solver=Qwen3-30A3-Thinking2026.03 | 51 | |
| KeyeVL1.5-8BLLM Solver=Qwen3-30A3-Thinking2026.03 | 45.19 |