User Retention on Kuaishou advertising dataset
0.7527AUCUniMixer-Lite-4-Blocks 84.5M
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| UniMixer-Lite-4-Blocks 84.5MParams=84.5M, FLOPs/Batch=4.24T2026.04 | 0.7527 | 0.8141 | 0.7425 | 0.8701 | |
| UniMixer-Lite-4-Blocks 38.2MParams=38.2M, FLOPs/Batch=1.26T2026.04 | 0.7523 | 0.775 | 0.7421 | 0.819 | |
| UniMixer-Lite-2-Blocks 76.2MParams=76.2M, FLOPs/Batch=2.60T2026.04 | 0.7514 | 0.6824 | 0.7412 | 0.7386 | |
| UniMixer-Lite-2-Blocks 42.4MParams=42.4M, FLOPs/Batch=2.17T2026.04 | 0.7511 | 0.6544 | 0.7407 | 0.691 | |
| UniMixer-2-Blocks 101.5MParams=101.5M, FLOPs/Batch=2.50T2026.04 | 0.7502 | 0.5661 | 0.74 | 0.6154 | |
| UniMixer-2-Blocks 67.5MParams=67.5M, FLOPs/Batch=2.07T2026.04 | 0.7498 | 0.5193 | 0.7393 | 0.5502 | |
| RankMixerParams=135.5M, FLOPs/Batch=1.68T2026.04 | 0.7493 | 0.4752 | 0.7389 | 0.5109 | |
| TokenMixer-LargeParams=103.3M, FLOPs/Batch=1.27T2026.04 | 0.7484 | 0.3833 | 0.7379 | 0.4111 | |
| FATParams=138.4M, FLOPs/Batch=1.83T2026.04 | 0.7449 | 0.0306 | 0.7343 | 0.0451 | |
| Heterogeneous AttentionParams=132.7M, FLOPs/Batch=1.68T2026.04 | 0.7446 | — | 0.7338 | — | |
| WukongParams=107.1M, FLOPs/Batch=1.40T2026.04 | 0.7445 | -0.01 | 0.7338 | 0.002 | |
| HiFormerParams=107.5M, FLOPs/Batch=1.37T2026.04 | 0.7417 | -0.2892 | 0.7311 | -0.2743 |