News Recommendation on MIND (test)
72.68AUCFastformer+PLM-NR*
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Fastformer+PLM-NR*User encoder=Fastformer, PLM=UniLM, ensemble=5 models2021.08 | 72.68 | 37.45 | 41.51 | 46.84 | — | |
| Fastformer+PLM-NRUser encoder=Fastformer, PLM=UniLM2021.08 | 71.04 | 35.91 | 39.16 | 45.03 | — | |
| PLM-NRUser encoder=UniLM2021.08 | 70.64 | 35.39 | 38.71 | 44.38 | — | |
| Fastformer2021.08 | 69.11 | 34.25 | 37.26 | 43.38 | — | |
| Poolingformer2021.08 | 68.54 | 33.6 | 36.69 | 42.6 | — | |
| FIM2021.08 | 68.31 | 33.42 | 36.47 | 42.35 | — | |
| Transformer2021.08 | 68.22 | 33.32 | 36.35 | 42.23 | — | |
| NRMS2021.08 | 68.18 | 33.29 | 36.31 | 42.2 | — | |
| BigBird2021.08 | 68.14 | 33.28 | 36.3 | 42.18 | — | |
| Linformer2021.08 | 68.02 | 33.19 | 36.22 | 42.1 | — | |
| Longformer2021.08 | 67.98 | 33.04 | 36.18 | 42.06 | — | |
| HieRec2021.06 | 67.95 | 32.87 | 36.36 | 42.53 | — | |
| Linear Transformers2021.08 | 67.76 | 32.94 | 36.16 | 41.97 | — | |
| GNewsRec2021.06 | 65.91 | 30.5 | 33.56 | 40.13 | — | |
| KRED2021.06 | 65.89 | 30.8 | 33.78 | 40.23 | — | |
| LSTUR2021.06 | 65.68 | 30.44 | 33.49 | 39.95 | — | |
| PUMATrainable Parameters (M)=88.12026.01 | 65.46 | — | — | — | 65.52 | |
| NRMS2021.06 | 65.43 | 30.74 | 33.13 | 39.66 | — | |
| EnCAggMalicious Client Ratio=10%, Attack Type=LIE2026.05 | 65.12 | 30.85 | 33.89 | 40.28 | — | |
| EnCAggMalicious Client Ratio=10%, Attack Type=UA-FedRec2026.05 | 65.07 | 30.59 | 33.54 | 40.02 | — | |
| EnCAggMalicious Client Ratio=10%, Attack Type=Min-Max2026.05 | 64.81 | 30.56 | 33.58 | 39.98 | — | |
| DPFLAMalicious Client Ratio=10%, Attack Type=LIE2026.05 | 64.79 | 30.39 | 33.21 | 39.81 | — | |
| DAN2021.06 | 64.68 | 29.78 | 32.63 | 39.27 | — | |
| FIM2021.06 | 64.65 | 29.7 | 32.51 | 39.3 | — | |
| DPFLAMalicious Client Ratio=10%, Attack Type=UA-FedRec2026.05 | 64.58 | 30.39 | 33.27 | 39.73 | — | |
| NAML2021.06 | 64.3 | 29.81 | 32.64 | 39.11 | — | |
| NPA2021.06 | 64.28 | 29.64 | 32.28 | 38.93 | — | |
| EnCAggMalicious Client Ratio=60%, Attack Type=Min-Max2026.05 | 64 | 30.15 | 32.89 | 39.36 | — | |
| DKN2021.06 | 63.99 | 28.95 | 31.73 | 38.38 | — | |
| FLGuardianMalicious Client Ratio=10%, Attack Type=UA-FedRec2026.05 | 63.66 | 29.52 | 32.21 | 38.72 | — | |
| EnCAggMalicious Client Ratio=60%, Attack Type=UA-FedRec2026.05 | 63.08 | 28.86 | 31.47 | 38.01 | — | |
| EnCAggMalicious Client Ratio=60%, Attack Type=LIE2026.05 | 62.87 | 29.11 | 31.55 | 38.11 | — | |
| EBNR2021.06 | 61.62 | 28.07 | 30.55 | 37.07 | — | |
| FLGuardianMalicious Client Ratio=10%, Attack Type=Min-Max2026.05 | 60.99 | 27.44 | 29.49 | 36.12 | — | |
| FLGuardianMalicious Client Ratio=10%, Attack Type=LIE2026.05 | 60.98 | 27.53 | 29.76 | 36.55 | — | |
| DPFLAMalicious Client Ratio=10%, Attack Type=Min-Max2026.05 | 60.47 | 26.83 | 29.08 | 35.6 | — | |
| FLTrustMalicious Client Ratio=10%, Attack Type=LIE2026.05 | 60.2 | 26.98 | 29.13 | 35.79 | — | |
| KrumMalicious Client Ratio=10%, Attack Type=UA-FedRec2026.05 | 58.38 | 25.39 | 27.49 | 34.14 | — | |
| Full RetrainingTrainable Parameters (M)=N/A2026.01 | 57.78 | — | — | — | 52.89 | |
| Source Model PerformanceTrainable Parameters (M)=N/A2026.01 | 57.42 | — | — | — | 53.12 | |
| FLTrustMalicious Client Ratio=10%, Attack Type=UA-FedRec2026.05 | 55.42 | 22.55 | 23.73 | 30.88 | — | |
| FLTrustMalicious Client Ratio=10%, Attack Type=Min-Max2026.05 | 55.03 | 23.93 | 24.86 | 31.52 | — | |
| TMeanMalicious Client Ratio=10%, Attack Type=LIE2026.05 | 54.16 | 23.22 | 24.62 | 31.27 | — | |
| FLTrustMalicious Client Ratio=60%, Attack Type=UA-FedRec2026.05 | 53.24 | 23.1 | 24 | 30.8 | — | |
| FLTrustMalicious Client Ratio=60%, Attack Type=LIE2026.05 | 53.09 | 22.71 | 23.8 | 30.49 | — | |
| MedianMalicious Client Ratio=10%, Attack Type=LIE2026.05 | 52.69 | 23.39 | 24.58 | 30.97 | — | |
| FLTrustMalicious Client Ratio=60%, Attack Type=Min-Max2026.05 | 52.49 | 22.6 | 23.68 | 30.17 | — | |
| KrumMalicious Client Ratio=10%, Attack Type=Min-Max2026.05 | 51.94 | 22.22 | 23.03 | 29.58 | — | |
| MedianMalicious Client Ratio=10%, Attack Type=Min-Max2026.05 | 51.83 | 24 | 25.21 | 31.4 | — | |
| KrumMalicious Client Ratio=10%, Attack Type=LIE2026.05 | 51.81 | 24.14 | 24.97 | 31.01 | — | |
| FedSGDMalicious Client Ratio=10%, Attack Type=LIE2026.05 | 51.49 | 22.9 | 23.79 | 30.13 | — | |
| FedSGDMalicious Client Ratio=10%, Attack Type=Min-Max2026.05 | 51.45 | 22.72 | 23.79 | 30.09 | — | |
| MedianMalicious Client Ratio=10%, Attack Type=UA-FedRec2026.05 | 51.41 | 21.61 | 22.4 | 29.03 | — | |
| TMeanMalicious Client Ratio=10%, Attack Type=Min-Max2026.05 | 50.67 | 22.4 | 23.4 | 29.63 | — | |
| TMeanMalicious Client Ratio=10%, Attack Type=UA-FedRec2026.05 | 50.46 | 23.14 | 23.66 | 29.53 | — | |
| DPFLAMalicious Client Ratio=60%, Attack Type=Min-Max2026.05 | 49.23 | 21.79 | 21.83 | 28.23 | — | |
| Random InitializationTrainable Parameters (M)=N/A2026.01 | 49.17 | — | — | — | 48.83 | |
| KrumMalicious Client Ratio=60%, Attack Type=LIE2026.05 | 49.13 | 21.77 | 21.89 | 28.09 | — | |
| DPFLAMalicious Client Ratio=60%, Attack Type=LIE2026.05 | 49.13 | 21.77 | 21.89 | 28.09 | — | |
| TMeanMalicious Client Ratio=60%, Attack Type=Min-Max2026.05 | 49 | 21.7 | 21.69 | 28.13 | — | |
| FedSGDMalicious Client Ratio=10%, Attack Type=UA-FedRec2026.05 | 48.93 | 21.76 | 21.65 | 27.88 | — | |
| FedSGDMalicious Client Ratio=60%, Attack Type=Min-Max2026.05 | 48.89 | 21.7 | 21.64 | 28.09 | — | |
| KrumMalicious Client Ratio=60%, Attack Type=Min-Max2026.05 | 48.78 | 21.63 | 21.59 | 27.95 | — | |
| FLGuardianMalicious Client Ratio=60%, Attack Type=Min-Max2026.05 | 48.67 | 21.56 | 21.52 | 27.89 | — | |
| MedianMalicious Client Ratio=60%, Attack Type=Min-Max2026.05 | 48.54 | 21.53 | 21.44 | 27.82 | — | |
| TMeanMalicious Client Ratio=60%, Attack Type=LIE2026.05 | 48.44 | 21.57 | 21.52 | 27.89 | — | |
| FedSGDMalicious Client Ratio=60%, Attack Type=LIE2026.05 | 48.27 | 21.6 | 21.52 | 27.81 | — | |
| MedianMalicious Client Ratio=60%, Attack Type=LIE2026.05 | 48.26 | 21.5 | 21.49 | 27.71 | — | |
| FLGuardianMalicious Client Ratio=60%, Attack Type=LIE2026.05 | 47.92 | 21.19 | 21.15 | 27.37 | — | |
| KrumMalicious Client Ratio=60%, Attack Type=UA-FedRec2026.05 | 47.61 | 20.28 | 19.46 | 26.48 | — | |
| FLGuardianMalicious Client Ratio=60%, Attack Type=UA-FedRec2026.05 | 47.6 | 20.43 | 19.79 | 26.68 | — | |
| MedianMalicious Client Ratio=60%, Attack Type=UA-FedRec2026.05 | 47.57 | 20.26 | 19.42 | 26.48 | — | |
| TMeanMalicious Client Ratio=60%, Attack Type=UA-FedRec2026.05 | 47.47 | 21.11 | 20.61 | 27.37 | — | |
| FedSGDMalicious Client Ratio=60%, Attack Type=UA-FedRec2026.05 | 47.39 | 21.09 | 20.57 | 27.33 | — | |
| DPFLAMalicious Client Ratio=60%, Attack Type=UA-FedRec2026.05 | 46.06 | 20.39 | 19.69 | 26.59 | — |