List your company

Language Model Calibration on SCITLDR (dev)

0.072smECEACUTE cosine Platt
0.06880.09040.1120.1336Jun 5, 2026

Evaluation results

MethodLinks
ACUTE cosine PlattEstimator=cosine, Recalibration=Platt2026.060.0720.6780.7210.9250.774
ACUTE pca20 IsotonicEstimator=PCA-20, Recalibration=Isotonic2026.060.0720.6920.7240.9250.78
ACUTE pca20 BetaEstimator=PCA-20, Recalibration=Beta2026.060.0720.6990.7230.9250.782
ACUTE cosine BetaEstimator=cosine, Recalibration=Beta2026.060.0730.6780.7210.9250.774
ACUTE pca20 PlattEstimator=PCA-20, Recalibration=Platt2026.060.0730.6980.7230.9250.782
ACUTE pca10 PlattEstimator=PCA-10, Recalibration=Platt2026.060.0740.6940.7220.9250.779
ACUTE pca10 BetaEstimator=PCA-10, Recalibration=Beta2026.060.0740.6940.7220.9250.779
ACUTE pca10 IsotonicEstimator=PCA-10, Recalibration=Isotonic2026.060.0750.6860.7230.9250.777
ACUTE cosine IsotonicEstimator=cosine, Recalibration=Isotonic2026.060.0780.6730.7180.9240.771
Platt2026.060.0790.6680.7210.9250.771
Isotonic2026.060.0790.6690.7210.9250.771
Beta2026.060.0790.6680.7210.9250.771
HRE2026.060.0810.6650.7210.9250.769
NWKR2026.060.0820.6670.7210.9250.77
ACUTE mid actLayers=middle activations2026.060.0840.6890.7220.9250.778
ACUTE late actLayers=late activations2026.060.0840.6810.7220.9250.775
ACUTE cosineEstimator=cosine2026.060.0850.6690.7170.9250.769
ACUTE early actLayers=early activations2026.060.0860.6860.7220.9250.777
ACUTE pca10Estimator=PCA-102026.060.0890.6850.7230.9250.777
ACUTE pca20Estimator=PCA-202026.060.0910.6880.7230.9250.778
Raw Conf2026.060.1520.3660.7210.9250.667