Functional Group Counting on ChemCoTBench
42FG ScoreQwen3-235B-A22B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3-235B-A22B2026.01 | 42 | 100 | |
| Qwen2.5-32B-Instruct2026.01 | 36 | 65 | |
| DeepSeek-R12026.01 | 27 | 155 | |
| Claude3.7-sonnet-think2026.01 | 21 | 160 | |
| Deepseek-V32026.01 | 15 | 150 | |
| O3-Mini2026.01 | 13 | 60 | |
| Gemini-2.5-Pro-think2026.01 | 11 | 60 | |
| ChemCRAFT2026.01 | 3 | 15 |