Confidence Estimation on DocILE (full) benchmark leaderboard · SOTA2 Research

Confidence Estimation on DocILE (full)

0.928AUCEXTRACTCONF

Evaluation Results

Method	Links
EXTRACTCONF2026.06		0.928	0.974	0.199	0.237	0.136	0.043	91.4
EXTRACTCONF2026.06		0.928	0.974	0.048	0.028	0.094	0.042	91.9
EXTRACTCONF2026.06		0.926	0.973	0.034	0.028	0.094	0.044	91.6
All except Mapper2026.06		0.911	0.967	0.184	0.223	0.141	0.065	89
OCR only2026.06		0.896	0.949	0.197	0.219	0.141	0.079	89.6
Logprobs + Entropy2026.06		0.88	0.953	0.18	0.261	0.162	0.076	87.6
Agreement only2026.06		0.828	0.902	0.207	0.283	0.186	0.102	87.5
Spatial only2026.06		0.814	0.897	0.258	0.34	0.22	0.103	86.5
Self-Consistency2026.06		0.744	0.852	0.075	0.072	0.183	0.138	86
Logprob Mean2026.06		0.705	0.864	0.245	0.245	0.253	0.145	84.6
Verbalized Conf.2026.06		0.692	0.828	0.163	0.163	0.213	0.146	84.6