Personalized News Headlines Generation on LaMP-4 v1 (test)
17.8ROUGE-1PersonaAgent
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PersonaAgentMethod Category=PersonaAgent2025.06 | 17.8 | 16.6 | |
| ReActMethod Category=General Agent2025.06 | 16.7 | 15 | |
| RAGMethod Category=Personalized LLM2025.06 | 16.1 | 14.5 | |
| PAGMethod Category=Personalized LLM2025.06 | 16 | 14.3 | |
| MemBankMethod Category=General Agent2025.06 | 16 | 14.2 | |
| ICLMethod Category=Non-Personalized2025.06 | 14 | 12.7 | |
| PromptMethod Category=Non-Personalized2025.06 | 12.9 | 11.8 | |
| TAP-PERBackbone=Qwen3-4B, variant=+Pu2026.06 | 0.189 | 0.168 | |
| RAGBackbone=Qwen3-4B, k=42026.06 | 0.184 | 0.164 | |
| P2PBackbone=Qwen3-4B, variant=single2026.06 | 0.184 | 0.166 | |
| PAGBackbone=Qwen3-4B, k=12026.06 | 0.179 | 0.159 | |
| RAGBackbone=Qwen3-4B, k=12026.06 | 0.176 | 0.157 | |
| RAGBackbone=Qwen3-4B, k=22026.06 | 0.175 | 0.156 | |
| TAP-PERBackbone=Qwen3-4B, variant=+Pq2026.06 | 0.175 | 0.154 | |
| PAGBackbone=Qwen3-4B, k=02026.06 | 0.174 | 0.154 | |
| TAP-PERBackbone=Qwen3-4B, variant=base2026.06 | 0.174 | 0.154 | |
| OPPUBackbone=Qwen3-4B, variant=+rag2026.06 | 0.168 | 0.152 | |
| OPPUBackbone=Qwen3-4B, variant=+pag2026.06 | 0.165 | 0.148 | |
| OPPUBackbone=Qwen3-4B, variant=base2026.06 | 0.163 | 0.146 | |
| PER-PCSBackbone=Qwen3-4B, variant=+rag2026.06 | 0.157 | 0.14 | |
| PER-PCSBackbone=Qwen3-4B, variant=+pag2026.06 | 0.156 | 0.14 | |
| PER-PCSBackbone=Qwen3-4B, variant=base2026.06 | 0.148 | 0.134 |