LaMP-3 Personalization on LaMP-3 (val)
0.231MAEPPlug
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PPlugRetrieval Category=PPlug2024.09 | 0.231 | 0.534 | |
| RSPG-PostRetrieval Category=Optimized RBP2024.09 | 0.246 | 0.539 | |
| PHFCompassParadigm=PHF Implements2026.06 | 0.26 | 0.579 | |
| RSPG-PreRetrieval Category=Optimized RBP2024.09 | 0.266 | 0.56 | |
| ROPG-RLRetrieval Category=Optimized RBP2024.09 | 0.273 | 0.561 | |
| ROPG-KDRetrieval Category=Optimized RBP2024.09 | 0.274 | 0.566 | |
| BM25Retrieval Category=Naive RBP2024.09 | 0.293 | 0.585 | |
| ContrieverRetrieval Category=Naive RBP2024.09 | 0.297 | 0.592 | |
| RecencyRetrieval Category=Naive RBP2024.09 | 0.305 | 0.596 | |
| PPlugParadigm=Flat: Aggregation-Based2026.06 | 0.314 | 0.805 | |
| T-H+T-FParadigm=PHF Implements2026.06 | 0.324 | 0.66 | |
| T-H+L-FParadigm=PHF Implements2026.06 | 0.334 | 0.655 | |
| FlanT5-XXLRetrieval Category=Ad-hoc2024.09 | 0.335 | 0.639 | |
| T-HParadigm=PHF Implements2026.06 | 0.355 | 0.691 | |
| T-FParadigm=PHF Implements2026.06 | 0.367 | 0.725 | |
| DenseParadigm=Flat: Retrieval-Based2026.06 | 0.414 | 0.75 | |
| L-FParadigm=PHF Implements2026.06 | 0.419 | 0.762 | |
| OPPUParadigm=Flat: Aggregation-Based2026.06 | 0.426 | 0.74 | |
| RecencyParadigm=Flat: Retrieval-Based2026.06 | 0.456 | 0.811 | |
| ROPGParadigm=Flat: Retrieval-Based2026.06 | 0.483 | 0.84 | |
| BM25Paradigm=Flat: Retrieval-Based2026.06 | 0.495 | 0.859 | |
| Zero-ShotBase Model=Qwen2.5-7B-Instruct2026.06 | 0.498 | 0.825 | |
| DiffMeanParadigm=Flat: Aggregation-Based2026.06 | 0.504 | 0.834 |