Personalized Speech-Script Generation on Personalized Deep Research Task 4 1.0 (test)
41.2R-1Perplexity-DR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Perplexity-DRcategory=Deep Research Agents2026.05 | 41.2 | 14.5 | 29.8 | 8.85 | 8.8 | 7.8 | 7.1 | |
| Gemini-DRcategory=Deep Research Agents2026.05 | 40.1 | 14.1 | 29.2 | 9.3 | 9.2 | 7.9 | 7.3 | |
| Grok-DRcategory=Deep Research Agents2026.05 | 39.5 | 13.8 | 28.5 | 8.9 | 8.95 | 8 | 7.4 | |
| PDRcategory=Personalized, backbone=DeepSeek R1-671B2026.05 | 38.84 | 13.44 | 28.53 | 9.05 | 8.83 | 9.2 | 9 | |
| OpenAI-DRcategory=Deep Research Agents2026.05 | 38.8 | 13.6 | 28 | 8.8 | 8.85 | 8.1 | 7.5 | |
| Iterative RAGcategory=Personalized, retrieval=multi-step retrieval, backbone=DeepSeek R1-671B2026.05 | 38.13 | 13.57 | 28.15 | 9.09 | 9.03 | 8.3 | 9.71 | |
| +Searchcategory=Non-personalized, search=public web search, backbone=DeepSeek R1-671B2026.05 | 38.12 | 13.42 | 27.46 | 7.73 | 8.58 | 7.98 | 6.02 | |
| Zero-shotcategory=Non-personalized, backbone=DeepSeek R1-671B2026.05 | 37.99 | 11.9 | 25.83 | 7.49 | 8.43 | 7.85 | 5.9 | |
| Profile Promptingcategory=Personalized, context=structured user context, backbone=DeepSeek R1-671B2026.05 | 37.24 | 12.34 | 26.41 | 8.72 | 8.75 | 8.24 | 7.62 |