Uncertainty Estimation on Books
64.53AUROCEnsemble (task)
Evaluation results
| Method | Links | |
|---|---|---|
| Ensemble (task)Probe Type=Pretrained, Probe Architecture=Linear, Feature Representation=Ensemble of probes on pooled data2026.06 | 64.53 | |
| Internal VarianceProbe Type=Pretrained, Probe Architecture=Linear, Feature Representation=Internal Variance2026.06 | 64.46 | |
| Layer Top-m Prob.Probe Type=Pretrained, Probe Architecture=Linear, Feature Representation=Layer Top-m Prob.2026.06 | 64.11 | |
| Lookback RatioProbe Type=Pretrained, Probe Architecture=Linear, Feature Representation=Lookback Ratio2026.06 | 59.87 | |
| Ensemble (probe)Probe Type=Pretrained, Probe Architecture=Linear, Feature Representation=Ensemble of three Internal variance probes2026.06 | 58.88 | |
| Embedding (last)Probe Type=Pretrained, Probe Architecture=Linear, Feature Representation=Embedding (last)2026.06 | 57.17 | |
| Linear (#64)Probe Type=Baseline, Probe Architecture=Linear, Number of Training Samples=64, Feature Representation=Embedding (last)2026.06 | 56.87 | |
| Linear (#256)Probe Type=Baseline, Probe Architecture=Linear, Number of Training Samples=256, Feature Representation=Embedding (last)2026.06 | 56.3 | |
| Linear (#128)Probe Type=Baseline, Probe Architecture=Linear, Number of Training Samples=128, Feature Representation=Embedding (last)2026.06 | 53.53 | |
| MLP (#128)Probe Type=Baseline, Probe Architecture=MLP, Number of Training Samples=128, Feature Representation=Embedding (last)2026.06 | 48.06 |