Personalized Scholarly Title Generation on LaMP-5 v1 (test)
51.2ROUGE-1RAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RAGBackbone=Qwen3-4B, k=22026.06 | 51.2 | 44.9 | |
| RAGBackbone=Qwen3-4B, k=42026.06 | 50.6 | 44.9 | |
| OPPUBackbone=Qwen3-4B, variant=base2026.06 | 50.4 | 43.9 | |
| PersonaAgentMethod Category=PersonaAgent2025.06 | 50.3 | 43.4 | |
| OPPUBackbone=Qwen3-4B, variant=+rag2026.06 | 50.1 | 44.7 | |
| OPPUBackbone=Qwen3-4B, variant=+pag2026.06 | 49.9 | 44.6 | |
| TAP-PERBackbone=Qwen3-4B, variant=+Pq2026.06 | 49.9 | 42.8 | |
| TAP-PERBackbone=Qwen3-4B, variant=base2026.06 | 49.5 | 43.1 | |
| TAP-PERBackbone=Qwen3-4B, variant=+Pu2026.06 | 49.5 | 43 | |
| PER-PCSBackbone=Qwen3-4B, variant=+pag2026.06 | 49.3 | 42.9 | |
| PER-PCSBackbone=Qwen3-4B, variant=+rag2026.06 | 49 | 42.1 | |
| RAGBackbone=Qwen3-4B, k=12026.06 | 48.9 | 42.2 | |
| PAGBackbone=Qwen3-4B, k=12026.06 | 48.1 | 41.9 | |
| P2PBackbone=Qwen3-4B, variant=single2026.06 | 48 | 42.6 | |
| PER-PCSBackbone=Qwen3-4B, variant=base2026.06 | 47.7 | 40.7 | |
| RAGMethod Category=Personalized LLM2025.06 | 47.5 | 42.4 | |
| PAGMethod Category=Personalized LLM2025.06 | 47.2 | 41.3 | |
| ReActMethod Category=General Agent2025.06 | 46.8 | 40.7 | |
| MemBankMethod Category=General Agent2025.06 | 46.3 | 39.9 | |
| PAGBackbone=Qwen3-4B, k=02026.06 | 45.9 | 40.1 | |
| PromptMethod Category=Non-Personalized2025.06 | 45.5 | 38.4 | |
| ICLMethod Category=Non-Personalized2025.06 | 44.4 | 38 |