List your company

Debiasing on Gemma-3-4b-it (test)

5.07Mean Log-Likelihood DifferenceLIT
4.93525.84516.7557.6649Dec 11, 2024

Evaluation results

MethodLinks
LITModel=Gemma-3-4b-it2024.125.0747.6
SFTModel=Gemma-3-4b-it2024.125.2858.3
DPOModel=Gemma-3-4b-it2024.125.5751.2
No control (baseline)Model=Gemma-3-4b-it2024.125.5957.3
RepEModel=Gemma-3-4b-it2024.127.8856.9
PromptingModel=Gemma-3-4b-it2024.128.4450.8