User Behavior Prediction on Alipay Industrial User Cognition Benchmark benchmark leaderboard · SOTA2 Research

User Behavior Prediction on Alipay Industrial User Cognition Benchmark

57.67Concert PerformanceGG-SM

Evaluation Results

Method
GG-SM2026.02	57.67	84.38	96.74	69.78	96.89	85.54	79.13	60.78	66.15	77.45
Qwen2.5-0.5B-Instruct w/ Hybridmlp2026.02	57.5	84.1	96.67	69.65	96.49	84.84	78.86	60.42	66.08	77.18
Qwen2.5-0.5B-Instruct w/ Hybridmask2026.02	57.48	83.11	96.71	69.51	96.53	85.2	79.13	60.56	65.65	77.1
Qwen2.5-0.5B-Instruct w/ Scheduler2026.02	57.42	84.19	96.64	69.73	96.88	85.4	79.08	60.56	66.05	77.33
Qwen2.5-0.5B-Instruct w/ Causal2026.02	57.16	83.13	96.69	69.67	96.78	84.73	79.22	60.54	65.89	77.09
InstructUE2026.02	57.12	83.94	96.61	69.64	96.95	85.34	79.27	60.71	65.94	77.28
Qwen2.5-0.5B-Instruct w/ Bidirectional2026.02	57.07	83.9	96.73	69.83	96.71	85.05	79.06	60.43	66.07	77.21
FOUND2026.02	56.7	83.3	95.74	68.24	96.69	85.13	84.72	61.02	60.59	76.9
Qwen2.5-0.5B-Instruct w/ Hybridgq2026.02	56.47	83.82	96.65	69.45	96.78	85.28	78.87	60.44	65.82	77.06
Llama-embed-nemotron2026.02	56.27	77.35	93.51	69.15	93.08	79.36	76.92	58.79	57.68	73.57
One4all2026.02	55.68	95.09	96.39	62.76	83.93	79.84	75.26	60.16	59.57	74.3
KaLM-Embedding2026.02	53.59	76.09	92.72	64	86.23	74.43	78.12	57.87	60.99	71.56
CPC2026.02	53.14	95.06	96.54	63.76	84.15	80.09	75.26	62.56	59.52	74.45
Qwen3-Embedding-0.6B2026.02	52.26	72.94	91.97	60.98	80.78	66.56	66.41	55.29	57.59	67.2
Oracle2026.02	51.73	72.19	92.02	56.42	76.38	65.61	64.35	54.15	55.92	65.42
MSDP2026.02	51.55	95.04	96.33	63.67	84.8	79.28	76.45	61.51	59	74.18