Generative Recommendation on Yelp (test)
1.88NG@5UGR
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| UGRbackbone=Qwen3-8B, beam size=102026.02 | 1.88 | 0.96 | 2.81 | 4.73 | 2.5 | — | — | |
| GFlowGR-TBModel=LETTER2025.06 | 1.73 | — | — | — | 2.22 | 2.61 | 4.13 | |
| TIGERCategory=LLM-based models (SID-based generative)2026.02 | 1.67 | 0.57 | 2.83 | 4.6 | 2.23 | — | — | |
| GFlowGR-TBModel=TIGER2025.06 | 1.66 | — | — | — | 2.13 | 2.56 | 4.04 | |
| GFlowGR-DBModel=LETTER2025.06 | 1.66 | — | — | — | 2.13 | 2.52 | 3.99 | |
| MiniOneRecCategory=LLM-based models (SID-based generative), backbone=Qwen3-8B2026.02 | 1.65 | 0.87 | 2.43 | 4.2 | 2.26 | — | — | |
| ReaRecCategory=Reasoning-enhanced models2026.02 | 1.63 | 0.74 | 2.58 | 4.7 | 2.32 | — | — | |
| R2ecCategory=Reasoning-enhanced models2026.02 | 1.61 | 0.66 | 2.53 | 4.64 | 2.27 | — | — | |
| S-DPOModel=LETTER2025.06 | 1.61 | — | — | — | 2.06 | 2.47 | 3.89 | |
| SASRecCategory=Traditional Models2026.02 | 1.53 | 0.59 | 2.53 | 4.41 | 2.13 | — | — | |
| GRPOModel=LETTER2025.06 | 1.46 | — | — | — | 1.95 | 2.28 | 3.8 | |
| GFlowGR-DBModel=TIGER2025.06 | 1.45 | — | — | — | 1.85 | 2.21 | 3.45 | |
| S-DPOModel=TIGER2025.06 | 1.37 | — | — | — | 1.76 | 2.12 | 3.33 | |
| SFTModel=TIGER2025.06 | 1.32 | — | — | — | 1.74 | 2.04 | 3.34 | |
| SFTModel=LETTER2025.06 | 1.31 | — | — | — | 1.75 | 2.05 | 3.41 | |
| IPAModel=LETTER2025.06 | 1.29 | — | — | — | 1.63 | 1.97 | 2.93 | |
| GRPOModel=TIGER2025.06 | 1.26 | — | — | — | 1.69 | 1.93 | 3.28 | |
| SPRecModel=LETTER2025.06 | 1.24 | — | — | — | 1.6 | 1.9 | 3.03 | |
| DPOModel=LETTER2025.06 | 1.15 | — | — | — | 1.51 | 1.72 | 2.86 | |
| SPRecCategory=LLM-based models (text-based)2026.02 | 0.81 | 0.66 | 0.96 | 1.13 | 0.87 | — | — | |
| SPRecModel=TIGER2025.06 | 0.67 | — | — | — | 0.9 | 1.03 | 1.86 | |
| IPAModel=TIGER2025.06 | 0.66 | — | — | — | 0.93 | 1.01 | 1.79 | |
| BIGRecCategory=LLM-based models (text-based)2026.02 | 0.63 | 0.36 | 0.89 | 1.19 | 0.73 | — | — | |
| DPOModel=TIGER2025.06 | 0.6 | — | — | — | 0.87 | 1 | 1.82 |