Sentiment Analysis on IMDB (test) (Epoch Progression Tracking)
83.27Accuracy @ Epoch 1BISR
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| BISRAmplification=True, Backbone=BERT-base, Epsilon=9, Delta=10^-5, Noise Multiplier=4.4, Learning Rate=0.15, Bandwidth=4, Clip Norm=102025.05 | 83.27 | 87.08 | 88.16 | 88.83 | 89.2 | 89.21 | 89.49 | 89.41 | 89.6 | 89.58 | |
| Band-Inv-MFAmplification=True, Backbone=BERT-base, Epsilon=9, Delta=10^-5, Noise Multiplier=8.2, Learning Rate=0.1, Bandwidth=4, Clip Norm=102025.05 | 82.91 | 86.92 | 88.25 | 88.6 | 89.02 | 89.23 | 89.5 | 89.5 | 89.65 | 89.53 | |
| Band-Inv-MFAmplification=False, Backbone=BERT-base, Epsilon=9, Delta=10^-5, Noise Multiplier=9.1, Learning Rate=0.1, Bandwidth=4, Clip Norm=102025.05 | 81.99 | 86.06 | 87.98 | 88.46 | 88.63 | 88.79 | 88.85 | 89.02 | 88.89 | 89.23 | |
| BISRAmplification=False, Backbone=BERT-base, Epsilon=9, Delta=10^-5, Noise Multiplier=5.8, Learning Rate=0.15, Bandwidth=4, Clip Norm=102025.05 | 81.85 | 86.65 | 87.6 | 88.64 | 88.9 | 88.83 | 89.02 | 89.43 | 89.37 | 89.42 | |
| BSRAmplification=False, Backbone=BERT-base, Epsilon=9, Delta=10^-5, Noise Multiplier=3.3, Learning Rate=0.02, Bandwidth=4, Clip Norm=102025.05 | 76.74 | 84.09 | 85.7 | 86.59 | 86.93 | 87.15 | 87.2 | 87.19 | 87.31 | 87.18 | |
| Band-MFAmplification=True, Backbone=BERT-base, Epsilon=9, Delta=10^-5, Noise Multiplier=2.4, Learning Rate=0.02, Bandwidth=4, Clip Norm=102025.05 | 76.66 | 84.66 | 86.36 | 87.22 | 87.62 | 87.89 | 88.04 | 88.16 | 88.33 | 88.31 | |
| BSRAmplification=True, Backbone=BERT-base, Epsilon=9, Delta=10^-5, Noise Multiplier=2.3, Learning Rate=0.02, Bandwidth=4, Clip Norm=102025.05 | 75.26 | 84.46 | 86.11 | 86.96 | 87.48 | 87.77 | 87.84 | 87.91 | 88.19 | 88.11 | |
| Band-MFAmplification=False, Backbone=BERT-base, Epsilon=9, Delta=10^-5, Noise Multiplier=3.5, Learning Rate=0.02, Bandwidth=4, Clip Norm=102025.05 | 73.39 | 83.63 | 85.39 | 86.09 | 86.99 | 87.08 | 87.23 | 87.34 | 87.34 | 87.08 | |
| DP-SGDAmplification=True, Backbone=BERT-base, Epsilon=9, Delta=10^-5, Noise Multiplier=1.2, Learning Rate=0.02, Bandwidth=1, Clip Norm=102025.05 | 71.23 | 82.42 | 84.45 | 85.57 | 86.18 | 86.64 | 86.93 | 86.99 | 87.26 | 87.43 | |
| DP-SGDAmplification=False, Backbone=BERT-base, Epsilon=9, Delta=10^-5, Noise Multiplier=1.8, Learning Rate=0.02, Bandwidth=1, Clip Norm=102025.05 | 62.94 | 78.21 | 83.05 | 84.17 | 85.01 | 85.4 | 85.53 | 85.8 | 85.81 | 85.71 |