Safety Evaluation on MaliciousGen & WildChat (test)
97.69Rule AdherenceStep-Level
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Step-LevelMalicious client ratio=30%, Backbone model=Qwen2.5-7B2026.01 | 97.69 | 95.38 | -0.8 | 5.24 | |
| Shadow-LevelMalicious client ratio=30%, Backbone model=Qwen2.5-7B2026.01 | 97.69 | 96.35 | -0.77 | 5.68 | |
| Client-LevelMalicious client ratio=30%, Backbone model=Qwen2.5-7B2026.01 | 97.31 | 95.77 | -0.76 | 5.33 | |
| KrumMalicious client ratio=30%, Backbone model=Qwen2.5-7B2026.01 | 72.12 | 56.15 | -1.93 | 5.24 | |
| FoolsGoldMalicious client ratio=30%, Backbone model=Qwen2.5-7B2026.01 | 65 | 40.77 | -2.65 | 5.61 | |
| TrimmedMeanMalicious client ratio=30%, Backbone model=Qwen2.5-7B2026.01 | 56.35 | 30.38 | -2.99 | 5.43 | |
| FedAvgMalicious client ratio=30%, Backbone model=Qwen2.5-7B2026.01 | 55.58 | 26.35 | -3.22 | 5.52 | |
| ResidualMalicious client ratio=30%, Backbone model=Qwen2.5-7B2026.01 | 54.23 | 22.88 | -3.3 | 5.36 |