Direct Recommendation on Amazon Clothing 5-core filtering (leave-one-out)
56.27Hit Rate @10VLM2Rec
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VLM2RecModel Category=Multimodal-based, Backbone=Qwen2.5-VL-3B2026.03 | 56.27 | 71.82 | 34.58 | 38.51 | |
| VLMSFT(Ext.)Model Category=Multimodal-based, Fusion Strategy=External, Training Strategy=SFT2026.03 | 50.22 | 64.74 | 31.64 | 35.31 | |
| VLMSFT(Int.)Model Category=Multimodal-based, Fusion Strategy=Internal, Training Strategy=SFT2026.03 | 45.31 | 61.78 | 30.15 | 32.84 | |
| LLMSFTModel Category=Text-based, Training Strategy=SFT2026.03 | 43.33 | 60.49 | 25.25 | 29.57 | |
| LLMEMBModel Category=Text-based2026.03 | 39.87 | 54.9 | 23.17 | 26.96 | |
| GRU4RecModel Category=ID-based2026.03 | 34.5 | 47.81 | 20.25 | 23.6 | |
| SASRecModel Category=ID-based2026.03 | 34.42 | 47.57 | 20.97 | 24.28 | |
| LLM2RecModel Category=Text-based2026.03 | 32.64 | 46.76 | 18.29 | 21.84 | |
| CLIPModel Category=Multimodal-based2026.03 | 30.61 | 40.43 | 18.87 | 21.35 | |
| LLMVanillaModel Category=Text-based, Training Strategy=Vanilla2026.03 | 28.49 | 40.52 | 16.63 | 19.66 | |
| VLMVanilla(Int.)Model Category=Multimodal-based, Fusion Strategy=Internal2026.03 | 26.61 | 35.77 | 18.3 | 20.6 | |
| VLMPromptModel Category=Multimodal-based2026.03 | 25.78 | 38.29 | 14.85 | 17.99 | |
| VLMVanilla(Ext.)Model Category=Multimodal-based, Fusion Strategy=External2026.03 | 24.59 | 37.99 | 13.75 | 17.11 | |
| SLIM+Model Category=Text-based2026.03 | 18.01 | 36.86 | 8.2 | 12.91 | |
| NoteLLM-2Model Category=Multimodal-based2026.03 | 17.64 | 34.31 | 8.15 | 12.33 | |
| SLIMModel Category=Text-based2026.03 | 13.74 | 27.47 | 6.32 | 9.75 | |
| BERTModel Category=Text-based2026.03 | 12.94 | 25.58 | 5.86 | 9.04 |