Confidence Calibration on MultiNLI Mismatch (test) benchmark leaderboard · SOTA2 Research

Confidence Calibration on MultiNLI Mismatch (test)

0.0071ECEMIR

Evaluation Results

Method	Links
MIR2023.06		0.0071	0.0107	0.0026	0.0258
IR2023.06		0.0088	0.0107	0.0036	0.0246
MIR + PROCAL2023.06		0.0103	0.0136	0.004	0.0235
HB + PROCAL2023.06		0.0105	0.015	0.0025	0.0251
HB2023.06		0.0111	0.0117	0.0036	0.0376
TS + PROCAL2023.06		0.0122	0.0135	0.004	0.0278
ETS + PROCAL2023.06		0.0124	0.0126	0.0039	0.0277
IR + PROCAL2023.06		0.0143	0.0123	0.0034	0.0261
Conf + PROCAL2023.06		0.0145	0.0146	0.0037	0.0278
ETS2023.06		0.0158	0.0156	0.0066	0.0304
TS2023.06		0.017	0.0176	0.0041	0.0303
PTS + PROCAL2023.06		0.0242	0.0246	0.0093	0.0356
Conf2023.06		0.0247	0.0262	0.0085	0.0354
PTSK + PROCAL2023.06		0.0426	0.044	0.0283	0.0515
PTS2023.06		0.0753	0.075	0.0421	0.0778
PTSK2023.06		0.1014	0.1014	0.074	0.1033