List your company

ResearchFormerly WizWand

StereoSet

Benchmarks

TaskDatasetSOTA resultTrendResults

Bias Measurement

StereoSet

63.17Overall SS

25

Stereotype Bias Evaluation

StereoSet Gender

99.59LMS Score

24

Out-of-Domain (OOD) Bias Evaluation

Stereoset

67.2Accuracy

14

Reasoning-intensive classification

StereoSet (test)

93Macro F1 Score

12

Stereotypical Bias Evaluation

StereoSet (dev)

84.172Overall LMS Score

12

Stereotypical Bias Evaluation

StereoSet (SS)

41StereoSet Score (SS)

10

Personalized Response Generation

StereoSet Explicit Preference (test)

79.1Preference Score

8

Personalized Response Generation

StereoSet Implicit Preference (test)

0.474Pref Score

8

Stereotype Bias Evaluation

StereoSet (test)

77.12Gender SS

8

Stereotype Bias Evaluation

StereoSet Overall

91.05LMS

8

Stereotype Detection

StereoSet n=237

93.4Accuracy

5

Language Model Debiasing

StereoSet (test)

0.854LMS Score

5

Bias Evaluation

StereoSet intrasentence

67.34Gender SS

3

Stereotype Bias Evaluation

StereoSet Race

77LMS

2

Stereotype Bias Evaluation

StereoSet Religion

84LMS

2

Stereotype Bias Evaluation

StereoSet Profession

78.4LMS

2