Error Prediction on TriviaQA (val)
81.3PRRlatent selective
Evaluation results
| Method | Links | |
|---|---|---|
| latent selectiveFeatures=all UQ, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 81.3 | |
| latent gatedFeatures=all UQ, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 79.5 | |
| latent selectiveFeatures=Sem. energy, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 79.3 | |
| oracle gatedFeatures=all UQ, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 78.8 | |
| baselineFeatures=all UQ, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 78.7 | |
| latent selectiveFeatures=SAR, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 78.6 | |
| latent selectiveFeatures=CoCoA, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 78.4 | |
| oracle selectiveFeatures=all UQ, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 77.8 | |
| latent gatedFeatures=Sem. energy, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 77.8 | |
| latent gatedFeatures=CoCoA, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 77.3 | |
| latent gatedFeatures=SAR, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 77.3 | |
| latent selectiveFeatures=MSP, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 77.1 | |
| latent selectiveFeatures=Sem. entropy, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 76.1 | |
| latent gatedFeatures=Sem. entropy, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 75.9 | |
| latent gatedFeatures=MSP, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 75.8 | |
| oracle gatedFeatures=Sem. energy, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 75.7 | |
| baselineFeatures=Sem. energy, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 75.4 | |
| baselineFeatures=CoCoA, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 75.3 | |
| oracle gatedFeatures=CoCoA, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 75.2 | |
| oracle selectiveFeatures=Sem. energy, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 74.8 | |
| oracle selectiveFeatures=CoCoA, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 74.2 | |
| oracle gatedFeatures=SAR, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 73.9 | |
| baselineFeatures=MSP, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 73.8 | |
| oracle gatedFeatures=MSP, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 73.8 | |
| baselineFeatures=SAR, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 73.5 | |
| oracle selectiveFeatures=SAR, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 72.9 | |
| oracle selectiveFeatures=MSP, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 72.5 | |
| oracle gatedFeatures=Sem. entropy, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 67.3 | |
| oracle selectiveFeatures=Sem. entropy, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 67.1 | |
| baselineFeatures=Sem. entropy, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 64.1 | |
| latent selectiveFeatures=MI, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 56.9 | |
| latent gatedFeatures=MI, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 56.8 | |
| baselineFeatures=MI, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 20.4 | |
| oracle selectiveFeatures=MI, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 19.7 | |
| oracle gatedFeatures=MI, Backbone=Qwen3-14B, Supervision=AlignScore2026.06 | 19.6 | |
| Selective Prediction framework (Spectrum-Qwen3-14B, all UQ)Model=Spectrum-Qwen3-14B, Features=all UQ, Evaluation Setting=latent selective2026.06 | 0.858 | |
| Baseline (Spectrum-Qwen3-14B, all UQ)Model=Spectrum-Qwen3-14B, Features=all UQ, Evaluation Setting=baseline2026.06 | 0.854 | |
| Selective Prediction framework (Llama-3.1-8B, all UQ)Model=Llama-3.1-8B, Features=all UQ, Evaluation Setting=latent selective, Supervision=AlignScore2026.06 | 0.85 | |
| Gated Experts model (Llama-3.1-8B, all UQ)Model=Llama-3.1-8B, Features=all UQ, Evaluation Setting=latent gated, Supervision=AlignScore2026.06 | 0.849 | |
| Baseline (Llama-3.1-8B, all UQ)Model=Llama-3.1-8B, Features=all UQ, Evaluation Setting=baseline, Supervision=AlignScore2026.06 | 0.848 | |
| Selective Prediction framework (Spectrum-Llama-3.1-8B, all UQ)Model=Spectrum-Llama-3.1-8B, Features=all UQ, Evaluation Setting=latent selective2026.06 | 0.836 | |
| Baseline (Spectrum-Llama-3.1-8B, all UQ)Model=Spectrum-Llama-3.1-8B, Features=all UQ, Evaluation Setting=baseline2026.06 | 0.831 | |
| Selective Prediction framework (Qwen3-14B, all UQ)Model=Qwen3-14B, Features=all UQ, Evaluation Setting=latent selective2026.06 | 0.813 | |
| Baseline (Qwen3-14B, all UQ)Model=Qwen3-14B, Features=all UQ, Evaluation Setting=baseline2026.06 | 0.787 | |
| Selective Prediction framework (A^2Search-7B, all UQ)Model=A^2Search-7B, Features=all UQ, Evaluation Setting=latent selective2026.06 | 0.773 | |
| Selective Prediction framework (Llama-3.1-8B, MI)Model=Llama-3.1-8B, Features=MI, Evaluation Setting=latent selective2026.06 | 0.763 | |
| Baseline (Llama-3.1-8B, MI)Model=Llama-3.1-8B, Features=MI, Evaluation Setting=baseline2026.06 | 0.747 | |
| Baseline (A^2Search-7B, all UQ)Model=A^2Search-7B, Features=all UQ, Evaluation Setting=baseline2026.06 | 0.742 | |
| Selective Prediction framework (A^2Search-7B, MI)Model=A^2Search-7B, Features=MI, Evaluation Setting=latent selective2026.06 | 0.482 | |
| Gated Experts model (A^2Search-7B, MI)Model=A^2Search-7B, Features=MI, Evaluation Setting=latent gated2026.06 | 0.48 | |
| Baseline (A^2Search-7B, MI)Model=A^2Search-7B, Features=MI, Evaluation Setting=baseline2026.06 | 0.214 |