Synthesis Operation Prediction on Inorganic Material Synthesis (Split 1)
0.4508NEDSPENDE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SPENDE2026.02 | 0.4508 | — | 0.5824 | 60.13 | |
| GPT-5.1few-shot settings=20-shot2026.02 | 0.5334 | 2.93 | 0.6583 | 71.01 | |
| GPT-5.1few-shot settings=40-shot2026.02 | 0.5434 | 2.74 | 0.666 | 71.46 | |
| Claude Haiku 4.5few-shot settings=20-shot2026.02 | 0.5534 | 2.56 | 0.6727 | 71.74 | |
| GPT-4ofew-shot settings=20-shot2026.02 | 0.5654 | 5.03 | 0.6925 | 72.19 | |
| Claude Haiku 4.5few-shot settings=40-shot2026.02 | 0.5669 | 4.11 | 0.6801 | 71.72 | |
| GPT-4ofew-shot settings=40-shot2026.02 | 0.5693 | 4.34 | 0.689 | 71.95 | |
| GPT-4o-minifew-shot settings=20-shot2026.02 | 0.5717 | 5.85 | 0.6992 | 73.55 | |
| GPT-4o-minifew-shot settings=40-shot2026.02 | 0.5844 | 5.94 | 0.7092 | 74.54 | |
| Retrieval based2026.02 | 0.6072 | 10.4 | 0.7194 | 75.96 | |
| MSP-LLMBackbone=LLaMA-3.1-8B2026.02 | 0.7174 | 26.51 | 0.8075 | 83.53 | |
| MSP-LLMBackbone=Qwen-2.5-7B2026.02 | 0.7207 | 26.51 | 0.81 | 83.59 |