# Retrosynthesis planning on Pistachio Hard

Source: [Retrosynthesis planning on Pistachio Hard](<https://www.sota2.com/research/sota/retrosynthesis-planning-on-pistachio-hard>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-12T10:51:49.971Z

Evaluation of models performing retrosynthesis planning on the Pistachio Hard dataset, measured using Solve Rate (%).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Retrosynthesis planning |
| Dataset (including any stated split) | Pistachio Hard |
| Metric | Solve Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 30 of 30 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Solve Rate](<https://www.sota2.com/research/sota/retrosynthesis-planning-on-pistachio-hard.md?metric=Solve%20Rate>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Solve Rate | Result date | Report paper |
| --- | --- | --- | --- |
| LLM-Syn-Planner | 87 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM-Syn-Planner | 86 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM-Syn-Planner | 86 | Not recorded | 68fa4a371e209131ce93cac1 |
| RootAligned | 85 | Not recorded | 68fa4a371e209131ce93cac1 |
| RootAligned | 85 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM-Syn-Planner | 84 | Not recorded | 68fa4a371e209131ce93cac1 |
| RootAligned | 83 | Not recorded | 68fa4a371e209131ce93cac1 |
| Graph2Edits | 82 | Not recorded | 68fa4a371e209131ce93cac1 |
| RootAligned | 82 | Not recorded | 68fa4a371e209131ce93cac1 |
| RootAligned | 82 | Not recorded | 68fa4a371e209131ce93cac1 |
| RootAligned | 78 | Not recorded | 68fa4a371e209131ce93cac1 |
| Graph2Edits | 74 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM-Syn-Planner | 74 | Not recorded | 68fa4a371e209131ce93cac1 |
| LocalRetro | 72 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM-Syn-Planner | 72 | Not recorded | 68fa4a371e209131ce93cac1 |
| Graph2Edits | 71 | Not recorded | 68fa4a371e209131ce93cac1 |
| LocalRetro | 69 | Not recorded | 68fa4a371e209131ce93cac1 |
| LocalRetro | 63 | Not recorded | 68fa4a371e209131ce93cac1 |
| Graph2Edits | 62 | Not recorded | 68fa4a371e209131ce93cac1 |
| LocalRetro | 62 | Not recorded | 68fa4a371e209131ce93cac1 |
| LocalRetro | 55 | Not recorded | 68fa4a371e209131ce93cac1 |
| LocalRetro | 52 | Not recorded | 68fa4a371e209131ce93cac1 |
| Graph2Edits | 41 | Not recorded | 68fa4a371e209131ce93cac1 |
| Graph2Edits | 26 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM | 5 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM | 5 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM | 4 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM | 2 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM | 0 | Not recorded | 68fa4a371e209131ce93cac1 |
| LLM | 0 | Not recorded | 68fa4a371e209131ce93cac1 |

### LLM-Syn-Planner

Solve Rate: 87. Result ID: 6a03063a47f34ce924e69d40.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o","N":"500"}. This record does not assert independent reproduction.

### LLM-Syn-Planner

Solve Rate: 86. Result ID: 6a03063a47f34ce924e69d3f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o","N":"300"}. This record does not assert independent reproduction.

### LLM-Syn-Planner

Solve Rate: 86. Result ID: 6a03063a47f34ce924e69d43.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Backbone":"DeepSeek-V3","N":"500"}. This record does not assert independent reproduction.

### RootAligned

Solve Rate: 85. Result ID: 6a03063a47f34ce924e69d2a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa42411e209131ce900eed.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"300"}. This record does not assert independent reproduction.

### RootAligned

Solve Rate: 85. Result ID: 6a03063a47f34ce924e69d2b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa42411e209131ce900eed.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"500"}. This record does not assert independent reproduction.

### LLM-Syn-Planner

Solve Rate: 84. Result ID: 6a03063a47f34ce924e69d42.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Backbone":"DeepSeek-V3","N":"300"}. This record does not assert independent reproduction.

### RootAligned

Solve Rate: 83. Result ID: 6a03063a47f34ce924e69d29.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa42411e209131ce900eed.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"100"}. This record does not assert independent reproduction.

### Graph2Edits

Solve Rate: 82. Result ID: 6a03063a47f34ce924e69d31.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"500"}. This record does not assert independent reproduction.

### RootAligned

Solve Rate: 82. Result ID: 6a03063a47f34ce924e69d33.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa42411e209131ce900eed.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"300"}. This record does not assert independent reproduction.

### RootAligned

Solve Rate: 82. Result ID: 6a03063a47f34ce924e69d34.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa42411e209131ce900eed.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"500"}. This record does not assert independent reproduction.

### RootAligned

Solve Rate: 78. Result ID: 6a03063a47f34ce924e69d32.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa42411e209131ce900eed.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"100"}. This record does not assert independent reproduction.

### Graph2Edits

Solve Rate: 74. Result ID: 6a03063a47f34ce924e69d30.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"300"}. This record does not assert independent reproduction.

### LLM-Syn-Planner

Solve Rate: 74. Result ID: 6a03063a47f34ce924e69d41.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Backbone":"DeepSeek-V3","N":"100"}. This record does not assert independent reproduction.

### LocalRetro

Solve Rate: 72. Result ID: 6a03063a47f34ce924e69d37.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"500"}. This record does not assert independent reproduction.

### LLM-Syn-Planner

Solve Rate: 72. Result ID: 6a03063a47f34ce924e69d3e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Backbone":"GPT-4o","N":"100"}. This record does not assert independent reproduction.

### Graph2Edits

Solve Rate: 71. Result ID: 6a03063a47f34ce924e69d2f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"100"}. This record does not assert independent reproduction.

### LocalRetro

Solve Rate: 69. Result ID: 6a03063a47f34ce924e69d36.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"300"}. This record does not assert independent reproduction.

### LocalRetro

Solve Rate: 63. Result ID: 6a03063a47f34ce924e69d35.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"100"}. This record does not assert independent reproduction.

### Graph2Edits

Solve Rate: 62. Result ID: 6a03063a47f34ce924e69d28.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"500"}. This record does not assert independent reproduction.

### LocalRetro

Solve Rate: 62. Result ID: 6a03063a47f34ce924e69d2e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"500"}. This record does not assert independent reproduction.

### LocalRetro

Solve Rate: 55. Result ID: 6a03063a47f34ce924e69d2d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"300"}. This record does not assert independent reproduction.

### LocalRetro

Solve Rate: 52. Result ID: 6a03063a47f34ce924e69d2c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"100"}. This record does not assert independent reproduction.

### Graph2Edits

Solve Rate: 41. Result ID: 6a03063a47f34ce924e69d27.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"300"}. This record does not assert independent reproduction.

### Graph2Edits

Solve Rate: 26. Result ID: 6a03063a47f34ce924e69d26.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"100"}. This record does not assert independent reproduction.

### LLM

Solve Rate: 5. Result ID: 6a03063a47f34ce924e69d3a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"500"}. This record does not assert independent reproduction.

### LLM

Solve Rate: 5. Result ID: 6a03063a47f34ce924e69d3d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"500"}. This record does not assert independent reproduction.

### LLM

Solve Rate: 4. Result ID: 6a03063a47f34ce924e69d39.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"300"}. This record does not assert independent reproduction.

### LLM

Solve Rate: 2. Result ID: 6a03063a47f34ce924e69d3c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"300"}. This record does not assert independent reproduction.

### LLM

Solve Rate: 0. Result ID: 6a03063a47f34ce924e69d38.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"MCTS","N":"100"}. This record does not assert independent reproduction.

### LLM

Solve Rate: 0. Result ID: 6a03063a47f34ce924e69d3b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa4a371e209131ce93cac1.md>)

Recorded evaluation configuration: {"Search Strategy":"Retro\*","N":"100"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
