User Behavior Prediction on Alipay Industrial User Cognition Benchmark
57.67Concert PerformanceGG-SM
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| GG-SMBackbone=Qwen2.5-0.5B-Instruct, Attention Mechanism=Bidirectional, Learning Strategy=Gradient-Guided Soft Masking2026.02 | 57.67 | 84.38 | 96.74 | 69.78 | 96.89 | 85.54 | 79.13 | 60.78 | 66.15 | 77.45 | |
| Qwen2.5-0.5B-Instruct w/ HybridmlpBackbone=Qwen2.5-0.5B-Instruct, Attention Mechanism=Hybrid2026.02 | 57.5 | 84.1 | 96.67 | 69.65 | 96.49 | 84.84 | 78.86 | 60.42 | 66.08 | 77.18 | |
| Qwen2.5-0.5B-Instruct w/ HybridmaskBackbone=Qwen2.5-0.5B-Instruct, Attention Mechanism=Hybrid2026.02 | 57.48 | 83.11 | 96.71 | 69.51 | 96.53 | 85.2 | 79.13 | 60.56 | 65.65 | 77.1 | |
| Qwen2.5-0.5B-Instruct w/ SchedulerBackbone=Qwen2.5-0.5B-Instruct, Attention Mechanism=Bidirectional, Evaluation Protocol=w/ Scheduler2026.02 | 57.42 | 84.19 | 96.64 | 69.73 | 96.88 | 85.4 | 79.08 | 60.56 | 66.05 | 77.33 | |
| Qwen2.5-0.5B-Instruct w/ CausalBackbone=Qwen2.5-0.5B-Instruct, Attention Mechanism=Causal2026.02 | 57.16 | 83.13 | 96.69 | 69.67 | 96.78 | 84.73 | 79.22 | 60.54 | 65.89 | 77.09 | |
| InstructUEModel Category=User Embedding Model2026.02 | 57.12 | 83.94 | 96.61 | 69.64 | 96.95 | 85.34 | 79.27 | 60.71 | 65.94 | 77.28 | |
| Qwen2.5-0.5B-Instruct w/ BidirectionalBackbone=Qwen2.5-0.5B-Instruct, Attention Mechanism=Bidirectional2026.02 | 57.07 | 83.9 | 96.73 | 69.83 | 96.71 | 85.05 | 79.06 | 60.43 | 66.07 | 77.21 | |
| FOUNDModel Category=User Embedding Model2026.02 | 56.7 | 83.3 | 95.74 | 68.24 | 96.69 | 85.13 | 84.72 | 61.02 | 60.59 | 76.9 | |
| Qwen2.5-0.5B-Instruct w/ HybridgqBackbone=Qwen2.5-0.5B-Instruct, Attention Mechanism=Hybrid2026.02 | 56.47 | 83.82 | 96.65 | 69.45 | 96.78 | 85.28 | 78.87 | 60.44 | 65.82 | 77.06 | |
| Llama-embed-nemotronModel Category=General Embedding Model, Backbone=Llama-embed-nemotron2026.02 | 56.27 | 77.35 | 93.51 | 69.15 | 93.08 | 79.36 | 76.92 | 58.79 | 57.68 | 73.57 | |
| One4allModel Category=User Embedding Model2026.02 | 55.68 | 95.09 | 96.39 | 62.76 | 83.93 | 79.84 | 75.26 | 60.16 | 59.57 | 74.3 | |
| KaLM-EmbeddingModel Category=General Embedding Model, Backbone=KaLM-Embedding2026.02 | 53.59 | 76.09 | 92.72 | 64 | 86.23 | 74.43 | 78.12 | 57.87 | 60.99 | 71.56 | |
| CPCModel Category=User Embedding Model2026.02 | 53.14 | 95.06 | 96.54 | 63.76 | 84.15 | 80.09 | 75.26 | 62.56 | 59.52 | 74.45 | |
| Qwen3-Embedding-0.6BModel Category=General Embedding Model, Backbone=Qwen3-0.6B2026.02 | 52.26 | 72.94 | 91.97 | 60.98 | 80.78 | 66.56 | 66.41 | 55.29 | 57.59 | 67.2 | |
| OracleBackbone=Qwen2.5-0.5B-Instruct, Attention Mechanism=Causal2026.02 | 51.73 | 72.19 | 92.02 | 56.42 | 76.38 | 65.61 | 64.35 | 54.15 | 55.92 | 65.42 | |
| MSDPModel Category=User Embedding Model2026.02 | 51.55 | 95.04 | 96.33 | 63.67 | 84.8 | 79.28 | 76.45 | 61.51 | 59 | 74.18 |