Deep Research on 56 deep research questions (test)
4.5Interest LevelHuman w/ DeepSeek R1, Cursor and Web-Search
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human w/ DeepSeek R1, Cursor and Web-SearchAvg. time consumed / per question=1h 48 mins, sample_size=6 questions2025.02 | 4.5 | 4.8 | 4.8 | 4.5 | |
| GPT-deep researchAvg. time consumed / per question=17.8 mins2025.02 | 4.1 | 4.8 | 4.2 | 4.5 | |
| OursAvg. time consumed / per question=6.8 mins2025.02 | 3.7 | 4.6 | 4.2 | 4.1 | |
| Gemini-deep researchAvg. time consumed / per question=7.7 mins2025.02 | 2.7 | 2.5 | 2.3 | 3 | |
| Perplexity-deep researchAvg. time consumed / per question=3.1 mins2025.02 | 2 | 2.1 | 1.6 | 2.1 |