Scientific Ideation on 30 open research questions from PhD candidates (test)
3.43Average NoveltyOur Method
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Our MethodInference strategy=BoN (10)2026.04 | 3.43 | 3.13 | 3.38 | |
| SFTTraining protocol=SFT2026.04 | 3.11 | 2.82 | 2.94 | |
| Base ModelModel architecture=14B, Quantization=4-bit2026.04 | 2.83 | 3.29 | 2.93 | |
| LDCTraining protocol=LDC2026.04 | 2.62 | 2.86 | 2.67 | |
| GPT Researcher2026.04 | 2.47 | 3.17 | 2.69 | |
| Research Agent2026.04 | 2.46 | 2.55 | 2.41 | |
| AI Scientist V22026.04 | 2.12 | 3.02 | 2.7 |