Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Confidence calibration research benchmarks · SOTA2 Research

Confidence calibration

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

81.2AUROC

84

Feb 26, 2026

0.013Confidence Calibration Error

66

Mar 12, 2026

CIFAR-100-LT (test)

Knowledge-Transferring-based Temperature Scaling

0.015ECE

53

Feb 26, 2026

0.001Calibration Error

44

Mar 12, 2026

0.008Calibration Error

44

Mar 12, 2026

Dirichlet Calibration

1.1Calibration Error

44

Mar 12, 2026

3.1ECE

41

Jun 9, 2026

0.031ECE

36

Feb 26, 2026

0.031ECE

36

Feb 26, 2026

0.07ECE

28

Feb 26, 2026

Probe (train on TriviaQA)

0.039Brier Score

27

Feb 26, 2026

0.03Calibration Error

22

Mar 12, 2026

0.006Calibration Error

22

Mar 12, 2026

4.4ECE

21

May 13, 2026

LogiQA (out-of-distribution)

ADVICE w/ ConfTuner

8ECE

18

May 4, 2026

MMLU out-of-distribution

5.6ECE

18

May 4, 2026

TriviaQA (in-domain)

ADVICE w/ ConfTuner

3.4Expected Calibration Error (ECE)

18

May 4, 2026

Average of four domains Relational Inference Planning

first-second-distance-based (FSD)

0.114Brier Score

18

Feb 26, 2026

MultiNLI Mismatch (test)

0.007ECE

16

Feb 26, 2026

Self-Consistency

1.5ECE

15

May 4, 2026

BeyondAIME (test)

Qwen3-4B-Instruct-ppo-value

1.202SNR Gain

15

Feb 26, 2026

iNaturalist 2021

0.65ECE

12

Feb 26, 2026

Qwen3-4B Calibration

0Brier Delta

10

May 20, 2026

FMNIST ID (test)

3.26ECE

9

Feb 26, 2026

MNIST ID (test)

0.14ECE

9

Feb 26, 2026

Page 1 of 2

PreviousNext

Popular datasets

Donkeycar SimpleQA Cora CIFAR TriviaQA

Follow for updates

Join SOTA2 Contact