Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Scientific ideation research benchmarks · SOTA2 Research

Scientific ideation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Scientific Ideation 60 samples human-validated (test)

3.63Novelty

9

Mar 20, 2026

30 open research questions from PhD candidates (test)

3.43Average Novelty

7

Apr 21, 2026

NeurIPS Overall 2025

Agentic-Ideation

6.74Novelty

6

Jul 1, 2026

NeurIPS 2025 (Others)

Agentic-Ideation

6.92Novelty

6

Jul 1, 2026

NeurIPS 2025 (CV)

Agentic-Ideation

6.74Novelty

6

Jul 1, 2026

Scientific Ideation (Human Evaluation)

Agentic-Ideation

6.71Novelty

6

Jul 1, 2026

Scientific Ideation Out-of-Domain

59GPT-5.2 Score

2

Mar 17, 2026

scientific papers Out-of-Domain

59Win Rate vs GPT-5.2

2

Mar 17, 2026

scientific papers In-Domain

61Win Rate vs GPT-5.2

2

Mar 17, 2026

Popular datasets

NeurIPS Scientific Ideation Scientific Papers open research questions from PhD candidates

Follow for updates

Join SOTA2 Contact