List your company

Recommendation on Movies (HR/NDCG/OOD Metrics)

0.17HR@10RecLM-token
-0.0020160.0426420.08730.131958May 6, 2025

Evaluation results

MethodLinks
RecLM-tokenMethod Type=LLMs (ours)2025.050.170.16220.16670.161110
LC-RecMethod Type=LLMs (item tokenizer)2025.050.16070.14580.15320.143400
SASRecMethod Type=Traditional Recommenders2025.050.1510.13510.14220.1323——
RecLM-cgenMethod Type=LLMs (ours)2025.050.14670.13110.140.12900
CtrlRecMethod Type=LLMs (finetuned)2025.050.13470.12480.13040.12349.028.13
PALRMethod Type=LLMs (finetuned)2025.050.13350.12440.12940.12334.6914.85
IDGenRecMethod Type=LLMs (item tokenizer)2025.050.12430.10640.11070.109800
LETTERMethod Type=LLMs (item tokenizer)2025.050.12050.10970.11360.100200
RecLM-retMethod Type=LLMs (ours)2025.050.11450.10520.10380.09700
SETRecMethod Type=LLMs (item tokenizer)2025.050.09290.08230.08670.080300
BIGRecMethod Type=LLMs (finetuned)2025.050.08610.0760.08230.074700
GRU4RecMethod Type=Traditional Recommenders2025.050.07220.05560.06250.0525——
Llama3-cgenMethod Type=LLMs (frozen)2025.050.02460.01060.01230.0064011.91
Llama3Method Type=LLMs (frozen)2025.050.00490.00250.00290.00193.1552.52
GPT-4oMethod Type=LLMs (frozen)2025.050.00460.00280.00270.00220.8961.21