Federated Instruction Following on Databricks-dolly-15k 1.0 (test)
83BLEUGradient Assembly Poisoning (GAP)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Gradient Assembly Poisoning (GAP)Backbone=LLaMA-13B, Condition=Adversarial2026.01 | 83 | 0.84 | 92 | 88 | 33.67 | 4.03 | 81 | |
| FedAvg (Base)Backbone=LLaMA-33B, Condition=Benign2026.01 | 81 | 0.78 | 88 | 84 | 18.01 | 5.11 | 68 | |
| Gradient Assembly Poisoning (GAP)Backbone=LLaMA-33B, Condition=Adversarial2026.01 | 81 | 0.78 | 92 | 82 | 38.02 | 5.32 | 64 | |
| FedAvg (Base)Backbone=LLaMA-7B, Condition=Benign2026.01 | 80 | 0.79 | 92 | 84 | 14.92 | 5.06 | 64 | |
| FedAvg (Base)Backbone=LLaMA-13B, Condition=Benign2026.01 | 77 | 0.83 | 92 | 75 | 21.6 | 4.85 | 82 | |
| FedAvg (Base)Backbone=ChatGLM-6B, Condition=Benign2026.01 | 76 | 0.86 | 92 | 92 | 21.32 | 3.9 | 82 | |
| Gradient Assembly Poisoning (GAP)Backbone=LLaMA-7B, Condition=Adversarial2026.01 | 71 | 0.74 | 92 | 81 | 30.42 | 5.09 | 57 | |
| FedAvg (Base)Backbone=GPT-2, Condition=Benign2026.01 | 69 | 0.53 | 90 | 71 | 5.85 | 4.23 | 41 | |
| Gradient Assembly Poisoning (GAP)Backbone=GPT-2, Condition=Adversarial2026.01 | 66 | 0.41 | 92 | 66 | 5.17 | 7.4 | 38 | |
| Gradient Assembly Poisoning (GAP)Backbone=ChatGLM-6B, Condition=Adversarial2026.01 | 57 | 0.79 | 87 | 72 | 70.09 | 13.26 | 70 |