Personalized Report Generation on Personalized Deep Research Task 3 1.0 (test)
39.2ROUGE-1 ScorePerplexity-DR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Perplexity-DRcategory=Deep Research Agents2026.05 | 39.2 | 14.1 | 32.1 | 9.2 | 8.65 | 4.25 | 6.55 | |
| Gemini-DRcategory=Deep Research Agents2026.05 | 37.1 | 13.2 | 30.5 | 8.95 | 8.45 | 4 | 6.2 | |
| PDRcategory=Personalized, backbone=DeepSeek R1-671B2026.05 | 36.84 | 12.93 | 30.5 | 9.04 | 8.44 | 6.89 | 7.2 | |
| Grok-DRcategory=Deep Research Agents2026.05 | 36.5 | 12.9 | 29.5 | 8.8 | 8.35 | 4.1 | 6.4 | |
| OpenAI-DRcategory=Deep Research Agents2026.05 | 35.8 | 12.6 | 29.2 | 8.7 | 8.25 | 4.4 | 6.7 | |
| Iterative RAGcategory=Personalized, retrieval=multi-step retrieval, backbone=DeepSeek R1-671B2026.05 | 35.79 | 12.74 | 28.77 | 8.9 | 8.37 | 4.78 | 6.74 | |
| +Searchcategory=Non-personalized, search=public web search, backbone=DeepSeek R1-671B2026.05 | 35.03 | 12.3 | 29.65 | 8.49 | 8.12 | 3.64 | 5.77 | |
| Profile Promptingcategory=Personalized, context=structured user context, backbone=DeepSeek R1-671B2026.05 | 34.59 | 12.45 | 27.89 | 8.52 | 8.14 | 4.49 | 6.7 | |
| Zero-shotcategory=Non-personalized, backbone=DeepSeek R1-671B2026.05 | 33.78 | 11.04 | 27.68 | 8.3 | 8.08 | 3.78 | 6.09 |