Research Idea Evaluation on ScholarIdeas Ecology
2.9CoverageScholarEval Claude
Evaluation results
| Method | Links | |
|---|---|---|
| ScholarEval ClaudeMethod Category=ScholarEval, Backbone=Claude-4-Sonnet2025.10 | 2.9 | |
| ScholarEval GPT-4.1Method Category=ScholarEval, Backbone=GPT-4.12025.10 | 2.52 | |
| DR TuluMethod Category=Deep Research, Backbone=DR Tulu2025.10 | 2.39 | |
| OpenAI Deep ResearchMethod Category=Deep Research, Backbone=OpenAI Deep Research2025.10 | 2.35 | |
| GPT-4.1Method Category=Language Models, Backbone=GPT-4.12025.10 | 2.13 | |
| Claude-4-SonnetMethod Category=Language Models, Backbone=Claude-4-Sonnet2025.10 | 2.11 | |
| ScholarEval GPT-5.1Method Category=ScholarEval, Backbone=GPT-5.1 Instant2025.10 | 2.09 | |
| GPT-5.1 InstantMethod Category=Language Models, Backbone=GPT-5.1 Instant2025.10 | 1.95 | |
| GPT-4o-search-previewMethod Category=Web-connected LM, Backbone=GPT-4o-search-preview2025.10 | 1.95 | |
| ScholarEval LlamaMethod Category=ScholarEval, Backbone=Llama-3.3-70B2025.10 | 1.94 | |
| Llama-3.3-70BMethod Category=Language Models, Backbone=Llama-3.3-70B2025.10 | 1.74 |