Utility Evaluation on Downstream Tasks
63.4Average AccuracyDAPT (nontoxic)
Evaluation results
| Method | Links | |
|---|---|---|
| DAPT (nontoxic)Parameter Size=530B2022.02 | 63.4 | |
| SGEAT (augmented)Parameter Size=530B, Training Samples=50k, Training Epochs=32022.02 | 62.6 | |
| SGEAT (augmented)Parameter Size=530B, Training Samples=100k, Training Epochs=32022.02 | 62 | |
| DAPT (nontoxic)Parameter Size=8.3B2022.02 | 59.1 | |
| SGEAT (augmented)Parameter Size=8.3B2022.02 | 59.1 | |
| SGEAT (augmented)Parameter Size=530B, Training Samples=50k, Training Epochs=52022.02 | 58.8 | |
| DAPT (nontoxic)Parameter Size=1.3B2022.02 | 54.7 | |
| SGEAT (augmented)Parameter Size=1.3B2022.02 | 54.4 | |
| DAPT (nontoxic)Parameter Size=357M2022.02 | 49.9 | |
| SGEAT (augmented)Parameter Size=357M2022.02 | 49.3 | |
| SGEAT (augmented)Parameter Size=126M2022.02 | 46.3 | |
| DAPT (nontoxic)Parameter Size=126M2022.02 | 46 |