Personalized Abstract Generation on Personalized Deep Research Dataset v1 (test)
0.3485ROUGE-1Gemini-DR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Gemini-DRApproach Category=Deep Research Agents2026.05 | 0.3485 | 0.154 | 0.131 | 6.1 | 7.95 | 5.2 | 7.05 | |
| Grok-DRApproach Category=Deep Research Agents2026.05 | 0.311 | 0.141 | 0.124 | 5.4 | 7.5 | 5 | 7.1 | |
| PDRApproach Category=Personalized2026.05 | 0.3099 | 0.1532 | 0.1211 | 5.82 | 7.71 | 7.82 | 9.51 | |
| Iterative RAGApproach Category=Personalized2026.05 | 0.3073 | 0.1522 | 0.1182 | 4.78 | 6.85 | 6.04 | 8.79 | |
| Perplexity-DRApproach Category=Deep Research Agents2026.05 | 0.305 | 0.138 | 0.122 | 5.1 | 7.2 | 5.15 | 7.3 | |
| OpenAI-DRApproach Category=Deep Research Agents2026.05 | 0.302 | 0.1395 | 0.121 | 5.3 | 7.4 | 5.4 | 7.55 | |
| Zero-shotApproach Category=Non-personalized2026.05 | 0.2996 | 0.1316 | 0.1202 | 4.55 | 6.93 | 4.81 | 7.78 | |
| Profile PromptingApproach Category=Personalized2026.05 | 0.2962 | 0.148 | 0.1209 | 5.28 | 7.43 | 5.38 | 8.42 | |
| +SearchApproach Category=Non-personalized2026.05 | 0.2903 | 0.142 | 0.1204 | 4.6 | 6.92 | 5.25 | 7.93 |