# Scientific hypothesis discovery on TOMATO-Chem2 (51 top-tier papers)

Source: [Scientific hypothesis discovery on TOMATO-Chem2 (51 top-tier papers)](<https://www.sota2.com/research/sota/scientific-hypothesis-discovery-on-tomato-chem2-51-top-tier-papers>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-29T09:03:12.173Z

Evaluation of model performance on scientific hypothesis discovery using the TOMATO-Chem2 dataset, which comprises 51 top-tier papers.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Scientific hypothesis discovery |
| Dataset (including any stated split) | TOMATO-Chem2 (51 top-tier papers) |
| Metric | Recall |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Recall](<https://www.sota2.com/research/sota/scientific-hypothesis-discovery-on-tomato-chem2-51-top-tier-papers.md?metric=Recall>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Recall | Result date | Report paper |
| --- | --- | --- | --- |
| MC2\_with\_strong\_feedback\_x4\_oracle\_rank | 26.96 | Not recorded | 6a191d7adbd7150506f82715 |
| MC2\_with\_strong\_feedback\_x3\_oracle\_rank | 25.7 | Not recorded | 6a191d7adbd7150506f82715 |
| MC2\_with\_strong\_feedback\_x2\_oracle\_rank | 25.54 | Not recorded | 6a191d7adbd7150506f82715 |
| MC2\_with\_strong\_feedback\_oracle\_rank | 23.1 | Not recorded | 6a191d7adbd7150506f82715 |
| MC2\_with\_feedback\_x3\_oracle\_rank | 22.35 | Not recorded | 6a191d7adbd7150506f82715 |
| MC2\_with\_feedback\_oracle\_rank | 21.98 | Not recorded | 6a191d7adbd7150506f82715 |
| MC2\_with\_feedback\_x2\_oracle\_rank | 21.91 | Not recorded | 6a191d7adbd7150506f82715 |
| MC2\_with\_feedback\_x4\_oracle\_rank | 20.99 | Not recorded | 6a191d7adbd7150506f82715 |
| MC2\_with\_MC\_input\_oracle\_rank | 18.26 | Not recorded | 6a191d7adbd7150506f82715 |
| MC\_with\_feedback\_with\_hint | 16.93 | Not recorded | 6a191d7adbd7150506f82715 |
| MC\_with\_soft\_feedback\_with\_hint | 16.78 | Not recorded | 6a191d7adbd7150506f82715 |
| MC\_with\_hint | 15.37 | Not recorded | 6a191d7adbd7150506f82715 |
| MC2\_with\_MC\_input\_self\_rank | 12.74 | Not recorded | 6a191d7adbd7150506f82715 |
| baseline\_MC | 11.44 | Not recorded | 6a191d7adbd7150506f82715 |
| baseline\_MC2 | 10.33 | Not recorded | 6a191d7adbd7150506f82715 |

### MC2\_with\_strong\_feedback\_x4\_oracle\_rank

Recall: 26.96. Result ID: 6a1954dffbc373592c13d45e.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle-ranking) + MC2 + \[(oracle ranking + strong feedback) + MC2\]x4","# Search Steps":"90.1"}. This record does not assert independent reproduction.

### MC2\_with\_strong\_feedback\_x3\_oracle\_rank

Recall: 25.7. Result ID: 6a1954dffbc373592c13d45d.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle-ranking) + MC2 + \[(oracle ranking + strong feedback) + MC2\]x3","# Search Steps":"123.1"}. This record does not assert independent reproduction.

### MC2\_with\_strong\_feedback\_x2\_oracle\_rank

Recall: 25.54. Result ID: 6a1954dffbc373592c13d45c.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle-ranking) + MC2 + \[(oracle ranking + strong feedback) + MC2\]x2","# Search Steps":"102.1"}. This record does not assert independent reproduction.

### MC2\_with\_strong\_feedback\_oracle\_rank

Recall: 23.1. Result ID: 6a1954dffbc373592c13d45b.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle-ranking) + MC2 + \[(oracle ranking + strong feedback) + MC2\]x1","# Search Steps":"129.4"}. This record does not assert independent reproduction.

### MC2\_with\_feedback\_x3\_oracle\_rank

Recall: 22.35. Result ID: 6a1954dffbc373592c13d459.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle-ranking) + MC2 + \[(oracle ranking + feedback) + MC2\]x3","# Search Steps":"123.1"}. This record does not assert independent reproduction.

### MC2\_with\_feedback\_oracle\_rank

Recall: 21.98. Result ID: 6a1954dffbc373592c13d457.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle-ranking) + MC2 + \[(oracle ranking + feedback) + MC2\]x1","# Search Steps":"166.1"}. This record does not assert independent reproduction.

### MC2\_with\_feedback\_x2\_oracle\_rank

Recall: 21.91. Result ID: 6a1954dffbc373592c13d458.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle-ranking) + MC2 + \[(oracle ranking + feedback) + MC2\]x2","# Search Steps":"149.9"}. This record does not assert independent reproduction.

### MC2\_with\_feedback\_x4\_oracle\_rank

Recall: 20.99. Result ID: 6a1954dffbc373592c13d45a.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle-ranking) + MC2 + \[(oracle ranking + feedback) + MC2\]x4","# Search Steps":"107.4"}. This record does not assert independent reproduction.

### MC2\_with\_MC\_input\_oracle\_rank

Recall: 18.26. Result ID: 6a1954dffbc373592c13d456.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle-ranking) + MC2","# Search Steps":"336.6"}. This record does not assert independent reproduction.

### MC\_with\_feedback\_with\_hint

Recall: 16.93. Result ID: 6a1954dffbc373592c13d454.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle ranking + feedback) + MC"}. This record does not assert independent reproduction.

### MC\_with\_soft\_feedback\_with\_hint

Recall: 16.78. Result ID: 6a1954dffbc373592c13d453.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (oracle ranking + soft feedback) + MC"}. This record does not assert independent reproduction.

### MC\_with\_hint

Recall: 15.37. Result ID: 6a1954dffbc373592c13d452.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint"}. This record does not assert independent reproduction.

### MC2\_with\_MC\_input\_self\_rank

Recall: 12.74. Result ID: 6a1954dffbc373592c13d455.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

Recorded evaluation configuration: {"Description":"MC + initial blueprint + (self-ranking) + MC2","# Search Steps":"321.2"}. This record does not assert independent reproduction.

### baseline\_MC

Recall: 11.44. Result ID: 6a1954dffbc373592c13d450.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78a11e209131cea797aa.md>)

Recorded evaluation configuration: {"Description":"MC"}. This record does not assert independent reproduction.

### baseline\_MC2

Recall: 10.33. Result ID: 6a1954dffbc373592c13d451.

[Reporting paper](<https://www.sota2.com/research/paper/6a191d7adbd7150506f82715.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78c01e209131cea7a450.md>)

Recorded evaluation configuration: {"Description":"MC2","# Search Steps":"478.6"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
