General and STEM reasoning on ChemBench
67.86Pass@1MINDLOOM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MINDLOOMModel Family=Qwen3.5, Model Size=9B2026.05 | 67.86 | 80.21 | |
| OpenThoughtModel Family=Qwen3.5, Model Size=9B2026.05 | 64.67 | 77.53 | |
| MegaScienceModel Family=Qwen3.5, Model Size=9B2026.05 | 63.53 | 78.48 | |
| BaseModel Family=Qwen3.5, Model Size=9B2026.05 | 63.2 | 77.17 | |
| DS-V3.2 DistillModel Family=Qwen3.5, Model Size=9B2026.05 | 62.9 | 78.05 | |
| MINDLOOMModel Family=Qwen3.5, Model Size=4B2026.05 | 62.67 | 73.52 | |
| MINDLOOMModel Family=Qwen3-2507, Model Size=4B2026.05 | 61.72 | 74.78 | |
| OpenThoughtModel Family=Qwen3-2507, Model Size=4B2026.05 | 60.7 | 72.26 | |
| MINDLOOMModel Family=Qwen3-2507, Model Size=8B2026.05 | 59.04 | 72.97 | |
| OpenThoughtModel Family=Qwen3.5, Model Size=4B2026.05 | 58.97 | 74.18 | |
| BaseModel Family=Qwen3.5, Model Size=4B2026.05 | 58.65 | 70.78 | |
| DS-V3.2 DistillModel Family=Qwen3.5, Model Size=4B2026.05 | 57.67 | 71.09 | |
| MegaScienceModel Family=Qwen3.5, Model Size=4B2026.05 | 57.36 | 71.87 | |
| MegaScienceModel Family=Qwen3-2507, Model Size=4B2026.05 | 57.32 | 67.1 | |
| BaseModel Family=Qwen3-2507, Model Size=4B2026.05 | 56.56 | 65.81 | |
| OpenThoughtModel Family=Qwen3-2507, Model Size=8B2026.05 | 55.97 | 70.1 | |
| MegaScienceModel Family=Qwen3-2507, Model Size=8B2026.05 | 54.72 | 70.41 | |
| BaseModel Family=Qwen3-2507, Model Size=8B2026.05 | 54.05 | 64.63 | |
| DS-V3.2 DistillModel Family=Qwen3-2507, Model Size=8B2026.05 | 53.07 | 69.16 | |
| DS-V3.2 DistillModel Family=Qwen3-2507, Model Size=4B2026.05 | 52.16 | 69.79 |