Automated Research Efficiency Analysis on 20 LLM-simulated scientists
15.8Average API CallsNanoResearch
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| NanoResearchRound=R32026.05 | 15.8 | 0.073 | 1.05 | 0.6 | 0.236 | 1.194 | 1.43 | |
| NanoResearchRound=R22026.05 | 18 | 0.092 | 1.51 | 1.13 | 0.284 | 2.258 | 2.542 | |
| NanoResearchRound=R12026.05 | 23.65 | 0.117 | 2.24 | 1.75 | 0.648 | 3.509 | 4.157 | |
| EvoScientist2026.05 | 24.67 | 0.428 | 1.35 | 1.02 | 0.914 | 2.03 | 2.944 | |
| AI Scientist-v22026.05 | 68.3 | 0.75 | 1.93 | 1.15 | 3.75 | 2.289 | 6.039 |