Cross-domain User Engagement Prediction on Internal Production Ads Dataset (val)
29.6Delta AUCMulti-Source SID
Evaluation results
| Method | Links | |
|---|---|---|
| Multi-Source SIDDescription=Structured 9-code, Activity-Tuned LLaMA backbone, Quantization=RQ-KMeans, K=3 codes per source2026.05 | 29.6 | |
| Independent combinationDescription=3 SIDs, separately indexed and summed, Quantization=RQ-KMeans, K=3 codes per source2026.05 | 26 | |
| Feed Activity SIDDescription=Direct behavioral signals (1-yr agg.), Quantization=RQ-KMeans, K=3 codes per source2026.05 | 21.3 | |
| Activity-Tuned LLaMA SIDDescription=Activity-trained, profile-prompted, Quantization=RQ-KMeans, K=3 codes per source2026.05 | 10.7 | |
| Profile Qwen SIDDescription=Text semantics only, no behavioral signal, Quantization=RQ-KMeans, K=3 codes per source2026.05 | 3.6 |