Rating Prediction on AmazonBook
0.369MAEContextSim
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ContextSimEvaluation protocol=default2026.01 | 0.369 | 0.511 | |
| ALIGNUSER+2026.01 | 0.3741 | 0.4649 | |
| ContextSim(fs)Evaluation protocol=few-shot2026.01 | 0.398 | 0.542 | |
| ALIGNUSER2026.01 | 0.3992 | 0.513 | |
| SimUSER2026.01 | 0.421 | 0.5676 | |
| SimUSER2026.01 | 0.421 | 0.568 | |
| Agent4Rec2026.01 | 0.671 | 0.879 | |
| Agent4Rec2026.01 | 0.6712 | 0.8788 | |
| All HistoryHistory context=All items, Profile generation method=None2026.05 | 0.864 | — | |
| 10 H+BLUEHistory context=10 items, Profile generation method=BLUE2026.05 | 0.867 | — | |
| RecMind-SImode=few-shot2026.01 | 0.9434 | 1.2139 | |
| MF2026.01 | 0.9879 | 1.2928 | |
| MF2026.01 | 0.988 | 1.293 | |
| 10 HistoryHistory context=10 items, Profile generation method=None2026.05 | 1.026 | — | |
| AFM2026.01 | 1.1018 | 1.3006 | |
| AFM2026.01 | 1.102 | 1.301 | |
| RecAgent2026.01 | 1.119 | 1.259 | |
| RecAgent2026.01 | 1.1191 | 1.2587 | |
| 10 H+LangPTuneHistory context=10 items, Profile generation method=LangPTune2026.05 | 1.151 | — | |
| 10 H+RLPFHistory context=10 items, Profile generation method=RLPF2026.05 | 1.164 | — | |
| 10 H+BaseHistory context=10 items, Profile generation method=Base2026.05 | 1.237 | — | |
| 10 H+RLAIFHistory context=10 items, Profile generation method=RLAIF2026.05 | 1.308 | — | |
| LangPTuneHistory context=None, Profile generation method=LangPTune2026.05 | 1.493 | — | |
| BLUEHistory context=None, Profile generation method=BLUE2026.05 | 1.535 | — | |
| RLPFHistory context=None, Profile generation method=RLPF2026.05 | 1.607 | — | |
| BaseHistory context=None, Profile generation method=Base2026.05 | 1.643 | — | |
| RLAIFHistory context=None, Profile generation method=RLAIF2026.05 | 1.785 | — |