Music Recommendation on Douyin Music (offline)
8.4PersonalizationMuChator
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MuChatorModel Source=Open-source LLMs, Evaluation Protocol=Tuning-based Methods2026.05 | 8.4 | 89.1 | 51.1 | 99.3 | |
| Qwen3-8BRAGModel Source=Open-source LLMs, Evaluation Protocol=Tuning-based Methods2026.05 | 7.1 | 81.2 | 42.2 | 97.4 | |
| Qwen3-8BSFTModel Source=Open-source LLMs, Evaluation Protocol=Tuning-based Methods2026.05 | 6.8 | 78.1 | 38.9 | 94.8 | |
| GPT-5.2Model Source=Proprietary LLMs, Evaluation Protocol=Zero-shot Prompting2026.05 | 6.6 | 67.1 | 14.6 | 55.3 | |
| GPT-5.2Model Source=Proprietary LLMs, Evaluation Protocol=Few-shot Prompting2026.05 | 6.6 | 69.3 | 14.3 | 57.1 | |
| Gemini-3-ProModel Source=Proprietary LLMs, Evaluation Protocol=Few-shot Prompting2026.05 | 5.7 | 79.1 | 11.3 | 49.5 | |
| Gemini-3-ProModel Source=Proprietary LLMs, Evaluation Protocol=Zero-shot Prompting2026.05 | 5.3 | 78.7 | 10.9 | 49 |