Reactant Prediction on USPTO-50k (test)
75Reactants AccuracyGemini-2.5-Pro
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Gemini-2.5-ProAvg. number of predictions=5.72025.10 | 75 | 45 | 81 | 540 | 1 | |
| GPT-5Avg. number of predictions=10.22025.10 | 68 | 44 | 73 | 538 | 3 | |
| Claude Sonnet 4Avg. number of predictions=4.82025.10 | 65 | 39 | 71 | 519 | 0 | |
| DeepSeek-R1-670BAvg. number of predictions=4.32025.10 | 62 | 28 | 69 | 528 | 13 | |
| Qwen3-235B-thinkingAvg. number of predictions=4.32025.10 | 54 | 28 | 59 | 522 | 19 | |
| Gemini 2.5 FlashAvg. number of predictions=4.32025.10 | 45 | 31 | 52 | 537 | 4 | |
| Qwen3-235B-instructAvg. number of predictions=6.62025.10 | 40 | 39 | 48 | 537 | 4 | |
| Qwen3-30BAvg. number of predictions=3.62025.10 | 22 | 12 | 27 | 535 | 6 | |
| Qwen3-4BAvg. number of predictions=2.92025.10 | 11 | 5 | 13 | 529 | 12 | |
| Ether0Avg. number of predictions=0.02025.10 | 0 | 0 | 0 | 0 | 541 |