Image Classification on MNIST (test) (Accuracy, Resource, and Training Metrics)
94.61AccuracyINT16
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| INT16Total Clients=50, Privacy Budget (epsilon)=10^42026.04 | 94.61 | 30.98 | 610 | |
| DynamicTotal Clients=50, Privacy Budget (epsilon)=10^4, b_min=8, lambda_h=0.752026.04 | 93.26 | 31.27 | 460 | |
| FP32Total Clients=50, Privacy Budget (epsilon)=10^42026.04 | 93.22 | 61.97 | 460 | |
| CosineTotal Clients=50, Privacy Budget (epsilon)=10^4, b_min=82026.04 | 93.04 | 38.75 | 460 | |
| INT8Total Clients=50, Privacy Budget (epsilon)=10^42026.04 | 92.85 | 15.49 | 460 | |
| FP32Total Clients=100, Privacy Budget (epsilon)=10^42026.04 | 83.49 | 123.93 | 970 | |
| DynamicTotal Clients=100, Privacy Budget (epsilon)=10^4, b_min=8, lambda_h=0.752026.04 | 82.13 | 61.3 | 890 | |
| CosineTotal Clients=100, Privacy Budget (epsilon)=10^4, b_min=82026.04 | 81.77 | 77.5 | 770 | |
| INT8Total Clients=100, Privacy Budget (epsilon)=10^42026.04 | 81.5 | 30.98 | 730 | |
| INT16Total Clients=100, Privacy Budget (epsilon)=10^42026.04 | 78.08 | 61.97 | 340 | |
| DynamicTotal Clients=200, Privacy Budget (epsilon)=10^4, b_min=8, lambda_h=0.752026.04 | 77.13 | 120.36 | 540 | |
| CosineTotal Clients=200, Privacy Budget (epsilon)=10^4, b_min=82026.04 | 76.99 | 155.01 | 990 | |
| INT4Total Clients=50, Privacy Budget (epsilon)=10^42026.04 | 76.65 | 7.75 | 860 | |
| INT8Total Clients=200, Privacy Budget (epsilon)=10^42026.04 | 76.49 | 61.97 | 540 | |
| INT16Total Clients=200, Privacy Budget (epsilon)=10^42026.04 | 74.96 | 123.93 | 710 | |
| FP32Total Clients=200, Privacy Budget (epsilon)=10^42026.04 | 72.49 | 247.86 | 620 | |
| FP32Total Clients=1000, Privacy Budget (epsilon)=10^42026.04 | 66.5 | 1,239.31 | 760 | |
| INT16Total Clients=1000, Privacy Budget (epsilon)=10^42026.04 | 65.76 | 619.65 | 980 | |
| DynamicTotal Clients=1000, Privacy Budget (epsilon)=10^4, b_min=8, lambda_h=0.752026.04 | 65.55 | 586.92 | 610 | |
| CosineTotal Clients=1000, Privacy Budget (epsilon)=10^4, b_min=82026.04 | 64.85 | 775.03 | 820 | |
| INT8Total Clients=1000, Privacy Budget (epsilon)=10^42026.04 | 64.4 | 309.83 | 990 | |
| INT4Total Clients=100, Privacy Budget (epsilon)=10^42026.04 | 60.49 | 15.49 | 380 | |
| INT4Total Clients=200, Privacy Budget (epsilon)=10^42026.04 | 49.37 | 30.98 | 230 | |
| INT4Total Clients=1000, Privacy Budget (epsilon)=10^42026.04 | 40.17 | 154.91 | 450 |