Research Idea Evaluation on D_point (randomly sampled 60 instances)
0.8848Rationality Win RateInnoEval
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| InnoEvalJudge=o4-mini, Baseline=CoT2026.02 | 0.8848 | 0.0922 | 0.9217 | 0.0276 | 0.9309 | 0.0691 | 0.8977 | 0.0977 | 0.907 | 0.0783 | |
| InnoEvalJudge=o4-mini, Baseline=RAG2026.02 | 0.871 | 0.1198 | 0.8756 | 0.1152 | 0.9263 | 0.0645 | 0.871 | 0.0968 | 0.9032 | 0.0837 | |
| InnoEvalJudge=o4-mini, Baseline=ResearchAgent2026.02 | 0.8618 | 0.1244 | 0.8618 | 0.0737 | 0.9032 | 0.0829 | 0.8894 | 0.0968 | 0.8986 | 0.0829 | |
| InnoEvalJudge=o4-mini, Baseline=InternAgent2026.02 | 0.8341 | 0.1567 | 0.871 | 0.0922 | 0.9124 | 0.0737 | 0.8203 | 0.1659 | 0.8571 | 0.129 | |
| InnoEvalJudge=o4-mini, Baseline=ScholarEval2026.02 | 0.6728 | 0.2811 | 0.6175 | 0.3272 | 0.7051 | 0.2811 | 0.8479 | 0.1429 | 0.7189 | 0.2581 |