Synthesis Operation Prediction on Inorganic Material Synthesis (Split 2)
0.4522NEDSPENDE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SPENDE2026.02 | 0.4522 | — | 0.5821 | 0.601 | — | — | — | |
| GPT-5.1few-shot settings=40-shot2026.02 | 0.5261 | 2.33 | 0.6498 | 0.6925 | — | — | — | |
| GPT-5.1few-shot settings=20-shot2026.02 | 0.5301 | 2.33 | 0.6547 | 0.6968 | — | — | — | |
| Claude Haiku 4.5few-shot settings=20-shot2026.02 | 0.5439 | 1.68 | 0.6656 | 0.7017 | — | — | — | |
| Claude Haiku 4.5few-shot settings=40-shot2026.02 | 0.5569 | 3.26 | 0.673 | 0.7037 | — | — | — | |
| GPT-4ofew-shot settings=20-shot2026.02 | 0.567 | 3.82 | 0.6865 | 0.7166 | — | — | — | |
| GPT-4ofew-shot settings=40-shot2026.02 | 0.5749 | 4.94 | 0.6924 | 0.7245 | — | — | — | |
| GPT-4o-minifew-shot settings=20-shot2026.02 | 0.5847 | 7.09 | 0.7089 | 0.7407 | — | — | — | |
| GPT-4o-minifew-shot settings=40-shot2026.02 | 0.5934 | 7.93 | 0.7141 | 0.7442 | — | — | — | |
| Retrieval based2026.02 | 0.603 | 11.19 | 0.7198 | 0.7564 | — | — | — | |
| MSP-LLMBackbone=Qwen-2.5-7B2026.02 | 0.742 | 32.18 | 0.824 | 0.8493 | — | — | — | |
| MSP-LLMBackbone=LLaMA-3.1-8B2026.02 | 0.7424 | 31.44 | 0.8235 | 0.8498 | — | — | — |