Precursor Prediction on Inorganic material synthesis dataset (Split 2)
72.85Top-1 AccMSP-LLM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MSP-LLMBackbone=LLaMA-3.1-8B2026.02 | 72.85 | 88.99 | 93.56 | 96.36 | |
| MSP-LLMBackbone=Qwen-2.5-7B2026.02 | 71.92 | 88.62 | 92.72 | 95.53 | |
| GPT-5.1Shots=20-shot2026.02 | 67.07 | 77.61 | 82.37 | 85.17 | |
| GPT-5.1Shots=40-shot2026.02 | 66.6 | 77.89 | 82.74 | 86.01 | |
| Retrieval-Retro2026.02 | 66.32 | 74.16 | 75.84 | 78.54 | |
| GPT-4oShots=40-shot2026.02 | 61.57 | 71.27 | 73.97 | 77.05 | |
| GPT-4oShots=20-shot2026.02 | 60.17 | 69.31 | 73.04 | 76.31 | |
| Claude Haiku 4.5Shots=40-shot2026.02 | 56.53 | 71.64 | 76.12 | 81.81 | |
| Claude Haiku 4.5Shots=20-shot2026.02 | 56.44 | 68.84 | 73.13 | 78.92 | |
| GPT-4o-miniShots=40-shot2026.02 | 55.97 | 64.27 | 67.82 | 71.36 | |
| GPT-4o-miniShots=20-shot2026.02 | 54.85 | 63.4 | 67.91 | 70.34 | |
| He et al.2026.02 | 54.01 | 61.1 | 62.69 | 65.02 |