Author Profiling on PAN16 (test)
93.8Task ScoreMODDIFFY-PAR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MODDIFFY-PARMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender & Age (Joint), Backbone=BERT-Base2022.05 | 93.8 | 52.3 | 28.3 | |
| FINETUNE-DEBIASMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender, Backbone=BERT-Base2022.05 | 93.7 | 52.3 | 34.8 | |
| FINETUNE-DEBIASMitigation Objective=MI Reduction, Target Attribute=Gender, Backbone=BERT-Base2022.05 | 93.7 | 62.2 | 41.9 | |
| FINETUNE-DEBIASMitigation Objective=MI Reduction, Target Attribute=Age, Backbone=BERT-Base2022.05 | 93.7 | 61.5 | 41.2 | |
| MODDIFFY-POSTMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender, Backbone=BERT-Base2022.05 | 93.7 | 57 | 45.4 | |
| MODDIFFY-POSTMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Age, Backbone=BERT-Base2022.05 | 93.7 | 63.7 | 31.7 | |
| MODDIFFY-PARMitigation Objective=MI Reduction, Target Attribute=Age, Backbone=BERT-Base2022.05 | 93.7 | 55 | 29.9 | |
| DIFFPRUN-DEBIASMitigation Objective=MI Reduction, Target Attribute=Gender & Age, Backbone=BERT-Base2022.05 | 93.6 | 73.3 | 57.2 | |
| MODDIFFY-POSTMitigation Objective=MI Reduction, Target Attribute=Gender, Backbone=BERT-Base2022.05 | 93.6 | 66.2 | 46.2 | |
| MODDIFFY-POSTMitigation Objective=MI Reduction, Target Attribute=Age, Backbone=BERT-Base2022.05 | 93.6 | 66.6 | 46.5 | |
| MODDIFFY-POSTMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender & Age (Joint), Backbone=BERT-Base2022.05 | 93.6 | 52.6 | 30.9 | |
| MODDIFFY-POSTMitigation Objective=MI Reduction, Target Attribute=Gender & Age (Joint), Backbone=BERT-Base2022.05 | 93.6 | 66.9 | 47.4 | |
| MODDIFFY-PARMitigation Objective=MI Reduction, Target Attribute=Gender, Backbone=BERT-Base2022.05 | 93.6 | 59.3 | 35.7 | |
| MODDIFFY-PARMitigation Objective=MI Reduction, Target Attribute=Gender & Age (Modular), Backbone=BERT-Base2022.05 | 93.6 | 56.1 | 30.1 | |
| MODDIFFY-PARMitigation Objective=MI Reduction, Target Attribute=Gender & Age (Joint), Backbone=BERT-Base2022.05 | 93.6 | 52.7 | 29.4 | |
| FINETUNEMitigation Objective=Adversarial Bias Mitigation, Backbone=BERT-Base2022.05 | 93.5 | 70.4 | 53.6 | |
| FINETUNEMitigation Objective=MI Reduction, Backbone=BERT-Base2022.05 | 93.5 | 70.4 | 53.6 | |
| FINETUNE-DEBIASMitigation Objective=MI Reduction, Target Attribute=Gender & Age, Backbone=BERT-Base2022.05 | 93.5 | 61.4 | 40.8 | |
| MODDIFFY-PARMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender, Backbone=BERT-Base2022.05 | 93.5 | 53 | 32.2 | |
| MODDIFFY-PARMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Age, Backbone=BERT-Base2022.05 | 93.5 | 53.8 | 30.1 | |
| MODDIFFY-PARMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender & Age (Modular), Backbone=BERT-Base2022.05 | 93.5 | 52.8 | 30.2 | |
| DIFFPRUN-DEBIASMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender, Backbone=BERT-Base2022.05 | 93.4 | 56.3 | 48.5 | |
| DIFFPRUN-DEBIASMitigation Objective=MI Reduction, Target Attribute=Age, Backbone=BERT-Base2022.05 | 93.4 | 73.1 | 57.1 | |
| MODDIFFY-POSTMitigation Objective=MI Reduction, Target Attribute=Gender & Age (Modular), Backbone=BERT-Base2022.05 | 93.4 | 66.4 | 46.6 | |
| DIFFPRUN-DEBIASMitigation Objective=MI Reduction, Target Attribute=Gender, Backbone=BERT-Base2022.05 | 93.3 | 73 | 58.2 | |
| FINETUNE-DEBIASMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender & Age, Backbone=BERT-Base2022.05 | 93 | 51.7 | 33.9 | |
| DIFFPRUNMitigation Objective=Adversarial Bias Mitigation, Backbone=BERT-Base2022.05 | 93 | 76.1 | 62.4 | |
| DIFFPRUNMitigation Objective=MI Reduction, Backbone=BERT-Base2022.05 | 93 | 76.1 | 62.4 | |
| FINETUNE-DEBIASMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Age, Backbone=BERT-Base2022.05 | 92.9 | 52.3 | 31.4 | |
| DIFFPRUN-DEBIASMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Age, Backbone=BERT-Base2022.05 | 92.9 | 64.5 | 34.1 | |
| DIFFPRUN-DEBIASMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender & Age, Backbone=BERT-Base2022.05 | 92.9 | 54.7 | 29.7 | |
| ADAPTER-DEBIASMitigation Objective=MI Reduction, Target Attribute=Gender & Age, Backbone=BERT-Base2022.05 | 92.8 | 64.2 | 34.9 | |
| MODDIFFY-POSTMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender & Age (Modular), Backbone=BERT-Base2022.05 | 92.3 | 57.7 | 32 | |
| ADAPTER-DEBIASMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender & Age, Backbone=BERT-Base2022.05 | 92.2 | 51.6 | 27.5 | |
| FINETUNE-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender & Age2022.05 | 91.9 | 62.5 | 42.1 | |
| FINETUNE-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender2022.05 | 91.7 | 54.6 | 42.2 | |
| MODDIFFY-POSTBackbone=BERT-Mini, Protected Attribute=Gender, Subnetwork Configuration=Post-hoc2022.05 | 91.7 | 55.7 | 42.7 | |
| MODDIFFY-PAR + dittoBackbone=BERT-Mini, Protected Attribute=Gender & Age, Subnetwork Configuration=Parallel, Assembly=Subnetworks trained separately then added2022.05 | 91.7 | 60.2 | 39.7 | |
| MODDIFFY-PARBackbone=BERT-Mini, Protected Attribute=Gender, Subnetwork Configuration=Parallel2022.05 | 91.6 | 55.9 | 41.7 | |
| FINETUNE-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender2022.05 | 91.6 | 61.3 | 42.4 | |
| MODDIFFY-PARBackbone=BERT-Mini, Protected Attribute=Gender, Subnetwork Configuration=Parallel2022.05 | 91.6 | 60.9 | 40.3 | |
| FINETUNEBackbone=BERT-Mini2022.05 | 91.5 | 64.8 | 46.8 | |
| MODDIFFY-POSTBackbone=BERT-Mini, Protected Attribute=Gender & Age, Subnetwork Configuration=Post-hoc2022.05 | 91.5 | 56.7 | 35.1 | |
| FINETUNEBackbone=BERT-Mini2022.05 | 91.5 | 64.8 | 88.4 | |
| MODDIFFY-POSTBackbone=BERT-Mini, Protected Attribute=Gender, Subnetwork Configuration=Post-hoc2022.05 | 91.5 | 62.6 | 43.7 | |
| MODDIFFY-POSTBackbone=BERT-Mini, Protected Attribute=Age, Subnetwork Configuration=Post-hoc2022.05 | 91.5 | 62.8 | 44 | |
| MODDIFFY-POST + dittoBackbone=BERT-Mini, Protected Attribute=Gender & Age, Subnetwork Configuration=Post-hoc, Assembly=Subnetworks trained separately then added2022.05 | 91.5 | 62.8 | 43.9 | |
| MODDIFFY-POSTBackbone=BERT-Mini, Protected Attribute=Gender & Age, Subnetwork Configuration=Post-hoc2022.05 | 91.5 | 63 | 43.9 | |
| MODDIFFY-PARBackbone=BERT-Mini, Protected Attribute=Age, Subnetwork Configuration=Parallel2022.05 | 91.5 | 60.8 | 41.6 | |
| MODDIFFY-PARBackbone=BERT-Mini, Protected Attribute=Gender & Age, Subnetwork Configuration=Parallel2022.05 | 91.5 | 60.7 | 41.3 | |
| MODDIFFY-POSTBackbone=BERT-Mini, Protected Attribute=Age, Subnetwork Configuration=Post-hoc2022.05 | 91.4 | 62.3 | 34.8 | |
| MODDIFFY-PAR + dittoBackbone=BERT-Mini, Protected Attribute=Gender & Age, Subnetwork Configuration=Parallel, Assembly=Subnetworks trained separately then added2022.05 | 91.4 | 60.7 | 39.6 | |
| FINETUNE-DEBIASBackbone=BERT-Mini, Protected Attribute=Age2022.05 | 91.4 | 61.9 | 43.2 | |
| MODDIFFY-PARBackbone=BERT-Mini, Protected Attribute=Age, Subnetwork Configuration=Parallel2022.05 | 91.3 | 61.3 | 37.6 | |
| MODDIFFY-PARBackbone=BERT-Mini, Protected Attribute=Gender & Age, Subnetwork Configuration=Parallel2022.05 | 91.3 | 55.5 | 33.7 | |
| FINETUNE-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender & Age2022.05 | 91.2 | 57 | 38.5 | |
| FINETUNE-DEBIASBackbone=BERT-Mini, Protected Attribute=Age2022.05 | 91.1 | 61.9 | 39.1 | |
| MODDIFFY-POST + dittoBackbone=BERT-Mini, Protected Attribute=Gender & Age, Subnetwork Configuration=Post-hoc, Assembly=Subnetworks trained separately then added2022.05 | 91 | 59.3 | 37.3 | |
| DIFFPRUN-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender2022.05 | 90.1 | 54.1 | 44.1 | |
| DIFFPRUNBackbone=BERT-Mini2022.05 | 90 | 67.2 | 49.4 | |
| DIFFPRUNBackbone=BERT-Mini2022.05 | 90 | 67.2 | 49.4 | |
| DIFFPRUN-DEBIASBackbone=BERT-Mini, Protected Attribute=Age2022.05 | 89.2 | 64.8 | 39.4 | |
| DIFFPRUN-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender & Age2022.05 | 89.1 | 57.9 | 35.8 | |
| ADAPTERMitigation Objective=Adversarial Bias Mitigation, Backbone=BERT-Base2022.05 | 87.3 | 67.8 | 37.1 | |
| ADAPTERMitigation Objective=MI Reduction, Backbone=BERT-Base2022.05 | 87.3 | 67.8 | 37.1 | |
| ADAPTER-DEBIASMitigation Objective=MI Reduction, Target Attribute=Age, Backbone=BERT-Base2022.05 | 87.1 | 67.1 | 36.6 | |
| ADAPTER-DEBIASMitigation Objective=MI Reduction, Target Attribute=Gender, Backbone=BERT-Base2022.05 | 87 | 67.4 | 37 | |
| ADAPTER-DEBIASMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Gender, Backbone=BERT-Base2022.05 | 86.9 | 54.9 | 29.2 | |
| DIFFPRUN-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender & Age2022.05 | 86.3 | 68.8 | 52.3 | |
| ADAPTER-DEBIASMitigation Objective=Adversarial Bias Mitigation, Target Attribute=Age, Backbone=BERT-Base2022.05 | 86.1 | 58.5 | 25.6 | |
| ADAPTER-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender & Age2022.05 | 82 | 64.2 | 34.9 | |
| ADAPTER-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender & Age2022.05 | 80.9 | 55.6 | 25.5 | |
| ADAPTER-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender2022.05 | 78.5 | 65.9 | 34.8 | |
| DIFFPRUN-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender2022.05 | 78.5 | 65.9 | 34.8 | |
| ADAPTERBackbone=BERT-Mini2022.05 | 78.4 | 65.8 | 35.3 | |
| ADAPTERBackbone=BERT-Mini2022.05 | 78.4 | 65.8 | 35.3 | |
| ADAPTER-DEBIASBackbone=BERT-Mini, Protected Attribute=Age2022.05 | 78.3 | 65.5 | 34.1 | |
| DIFFPRUN-DEBIASBackbone=BERT-Mini, Protected Attribute=Age2022.05 | 78.3 | 65.5 | 34.1 | |
| ADAPTER-DEBIASBackbone=BERT-Mini, Protected Attribute=Gender2022.05 | 78.1 | 59.6 | 32 | |
| ADAPTER-DEBIASBackbone=BERT-Mini, Protected Attribute=Age2022.05 | 77.3 | 60.5 | 27.3 |