Calibration on CivilComments BERT (test)
1.08ECE (Oracle Estimate)Platt
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| PlattDistribution Setting (Base, Post)=(UU, UU), Backbone=BERT2026.05 | 1.08 | 5.52 | 0.25 | 1.09 | 6.7 | 0.25 | 91.2 | |
| PlattDistribution Setting (Base, Post)=(PN, PN), Backbone=BERT2026.05 | 1.31 | 10.83 | 0.65 | 1.31 | 10.83 | 0.65 | 90.94 | |
| WLMCDistribution Setting (Base, Post)=(PN, PN), Backbone=BERT2026.05 | 1.35 | 9.16 | 0.61 | 1.35 | 9.16 | 0.61 | 90.96 | |
| ERMDistribution Setting (Base, Post)=(PN, PN), Backbone=BERT2026.05 | 1.64 | 9.8 | 0.87 | 1.64 | 9.79 | 0.87 | 90.96 | |
| TempDistribution Setting (Base, Post)=(PN, PN), Backbone=BERT2026.05 | 2.48 | 8.64 | 1.52 | 2.48 | 8.64 | 1.52 | 90.96 |