Long-tail retrieval on NIAH 7-client multi-needle retrieval (non-IID partition)
40MK-NIAHFedALA
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| FedALABackbone=Llama-3.2-1B, Target Depths=1K, 2K, 4K, 8K, 16K, Evaluation Protocol=Personalized2026.05 | 40 | 40 | 33.3 | 33.3 | 13.3 | 20 | 20 | 28.6 | |
| FedNLBackbone=Titans-Llama-3.2-1B, Target Depths=1K, 2K, 4K, 8K, 16K, Evaluation Protocol=Personalized2026.05 | 32 | 40 | 24 | 48 | 24 | 28 | 12 | 29.7 | |
| FedProxBackbone=Llama-3.2-1B, Target Depths=1K, 2K, 4K, 8K, 16K, Evaluation Protocol=Personalized2026.05 | 24 | 16 | 24 | 8 | 16 | 32 | 20 | 20 | |
| FedAvgBackbone=Llama-3.2-1B, Target Depths=1K, 2K, 4K, 8K, 16K, Evaluation Protocol=Personalized2026.05 | 16 | 24 | 24 | 16 | 16 | 20 | 12 | 18.3 | |
| FedSSIBackbone=Llama-3.2-1B, Target Depths=1K, 2K, 4K, 8K, 16K, Evaluation Protocol=Personalized2026.05 | 16 | 24 | 24 | 16 | 16 | 20 | 12 | 18.3 | |
| FFA-LoRABackbone=Llama-3.2-1B, Target Depths=1K, 2K, 4K, 8K, 16K, Evaluation Protocol=Personalized2026.05 | 13.3 | 20 | 26.7 | 13.3 | 13.3 | 13.3 | 6.7 | 15.2 | |
| Fed-MambaBackbone=Mamba-1.4B, Target Depths=1K, 2K, 4K, 8K, 16K, Evaluation Protocol=Personalized2026.05 | 12 | 20 | 20 | 20 | 20 | 28 | 12 | 18.9 |