Sentiment Analysis on SST-2 (test) (SEAT Bias Evaluation)
0.03SEAT e-size: Names (Career/Family)Origin
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| OriginBackbone=BERT2023.07 | 0.03 | 0.01 | 0.21 | 1.15 | 0.1 | 0.22 | 0.291 | 91.97 | |
| Gender-tuningBackbone=BERT2023.07 | 0.03 | 0.16 | 0.39 | 0.31 | 0.07 | 0.1 | 0.176 | 92.1 | |
| OriginBackbone=RoBERTa2023.07 | 0.07 | 0.33 | 1.32 | 1.34 | 0.25 | 0.47 | 0.63 | 93.57 | |
| Gender-tuning-randomBackbone=RoBERTa, Masking=Random2023.07 | 0.08 | 0.44 | 1.25 | 1.12 | 0.12 | 0.62 | 0.605 | 93.92 | |
| Sent-DBackbone=BERT2023.07 | 0.1 | 0.05 | 0.22 | 0.75 | 0.08 | 0.04 | 0.212 | 89.1 | |
| Gender-tuningBackbone=RoBERTa2023.07 | 0.14 | 0.01 | 0.57 | 1.11 | 0.47 | 0.47 | 0.461 | 93.69 | |
| FairFBackbone=BERT2023.07 | 0.21 | 0.37 | 0.26 | 0.09 | 0.12 | 0.005 | 0.182 | 91.6 | |
| Gender-tuning-randomBackbone=BERT, Masking=Random2023.07 | 0.46 | 0.03 | 0.05 | 0.65 | 0.42 | 0.38 | 0.331 | 92.66 |