List your company
ResearchFormerly WizWand

Personalization on LaMP-3

0.241MAEPersonaAgent
0.2360.269750.30350.33725May 27, 2025May 28, 2025May 30, 2025Jun 1, 2025Jun 2, 2025Jun 4, 2025Jun 6, 2025
Updated 5mo ago

Evaluation results

MethodLinks
PersonaAgentLLM Backbone=Claude-3.5 Sonnet2025.060.2410.509
RPMBackbone=GPT-4o-mini, +CoT=false, Reasoning generation=enabled2025.050.2590.548
ICLLLM Backbone=Claude-3.5 Sonnet, Category=Non-Personalized2025.060.2770.543
PromptLLM Backbone=Claude-3.5 Sonnet, Category=Non-Personalized2025.060.2950.59
RPMBackbone=GPT-4o-mini, +CoT=false, Reasoning generation=disabled2025.050.3050.599
FermiBackbone=GPT-4o-mini, +CoT=true2025.050.3120.635
RAGLLM Backbone=Claude-3.5 Sonnet, Category=Personalized LLM2025.060.3130.713
ReActLLM Backbone=Claude-3.5 Sonnet, Category=General Agent2025.060.3130.59
ICLBackbone=GPT-4o-mini, +CoT=true2025.050.3170.625
MemBankLLM Backbone=Claude-3.5 Sonnet, Category=General Agent2025.060.3210.582
Zero-shotBackbone=GPT-4o-mini, +CoT=true2025.050.3230.63
HYDRABackbone=GPT-4o-mini, +CoT=false2025.050.3240.656
FermiBackbone=GPT-4o-mini, +CoT=false2025.050.3280.628
PAGBackbone=GPT-4o-mini, +CoT=false2025.050.3310.662
ICLBackbone=GPT-4o-mini, +CoT=false2025.050.3330.638
PAGBackbone=GPT-4o-mini, +CoT=true2025.050.3390.672
PAGLLM Backbone=Claude-3.5 Sonnet, Category=Personalized LLM2025.060.3390.835
HYDRABackbone=GPT-4o-mini, +CoT=true2025.050.3530.672
Zero-shotBackbone=GPT-4o-mini, +CoT=false2025.050.3610.68
RAGBackbone=GPT-4o-mini, +CoT=false2025.050.3630.687
RAGBackbone=GPT-4o-mini, +CoT=true2025.050.3660.69