# Span-level uncertainty estimation on SPANUQ-BENCH v1.0 (test) Source: [Span-level uncertainty estimation on SPANUQ-BENCH v1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-07-08T07:01:22.396Z Evaluation of model performance on the test split of the SPANUQ-BENCH v1.0 dataset, focusing on span-level uncertainty estimation using metrics like AUROC, MAE, and Spearman correlation. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Span-level uncertainty estimation | | Dataset (including any stated split) | SPANUQ-BENCH v1.0 (test) | | Metric | AUROC | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 35 of 35 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [AUROC](): Higher is better; unit: SCALAR. - [MAE](): Lower is better; unit: SCALAR. - [Spearman Corr](): Higher is better; unit: SCALAR. ## Recorded results | Method | AUROC | Result date | Report paper | | --- | --- | --- | --- | | SPANUQ | 0.944 | Not recorded | 6a4dd9b34da6617fe9198c50 | | SPANUQ | 0.939 | Not recorded | 6a4dd9b34da6617fe9198c50 | | SPANUQ | 0.936 | Not recorded | 6a4dd9b34da6617fe9198c50 | | SPANUQ | 0.93 | Not recorded | 6a4dd9b34da6617fe9198c50 | | SPANUQ | 0.908 | Not recorded | 6a4dd9b34da6617fe9198c50 | | MLP Probe | 0.893 | Not recorded | 6a4dd9b34da6617fe9198c50 | | MLP Probe | 0.884 | Not recorded | 6a4dd9b34da6617fe9198c50 | | MLP Probe | 0.881 | Not recorded | 6a4dd9b34da6617fe9198c50 | | MLP Probe | 0.873 | Not recorded | 6a4dd9b34da6617fe9198c50 | | MLP Probe | 0.863 | Not recorded | 6a4dd9b34da6617fe9198c50 | | SelfCheckGPT-NLI | 0.816 | Not recorded | 6a4dd9b34da6617fe9198c50 | | SelfCheckGPT-NLI | 0.813 | Not recorded | 6a4dd9b34da6617fe9198c50 | | SelfCheckGPT-NLI | 0.808 | Not recorded | 6a4dd9b34da6617fe9198c50 | | SelfCheckGPT-NLI | 0.801 | Not recorded | 6a4dd9b34da6617fe9198c50 | | SelfCheckGPT-NLI | 0.782 | Not recorded | 6a4dd9b34da6617fe9198c50 | | FActScore | 0.762 | Not recorded | 6a4dd9b34da6617fe9198c50 | | FActScore | 0.714 | Not recorded | 6a4dd9b34da6617fe9198c50 | | FActScore | 0.701 | Not recorded | 6a4dd9b34da6617fe9198c50 | | FActScore | 0.661 | Not recorded | 6a4dd9b34da6617fe9198c50 | | FActScore | 0.625 | Not recorded | 6a4dd9b34da6617fe9198c50 | | Token Entropy | 0.603 | Not recorded | 6a4dd9b34da6617fe9198c50 | | Verbalized Conf. | 0.598 | Not recorded | 6a4dd9b34da6617fe9198c50 | | Verbalized Conf. | 0.595 | Not recorded | 6a4dd9b34da6617fe9198c50 | | Verbalized Conf. | 0.593 | Not recorded | 6a4dd9b34da6617fe9198c50 | | Token Entropy | 0.592 | Not recorded | 6a4dd9b34da6617fe9198c50 | | Token Entropy | 0.58 | Not recorded | 6a4dd9b34da6617fe9198c50 | | Token Entropy | 0.575 | Not recorded | 6a4dd9b34da6617fe9198c50 | | Verbalized Conf. | 0.574 | Not recorded | 6a4dd9b34da6617fe9198c50 | | Token Entropy | 0.569 | Not recorded | 6a4dd9b34da6617fe9198c50 | | P(True) | 0.546 | Not recorded | 6a4dd9b34da6617fe9198c50 | | P(True) | 0.541 | Not recorded | 6a4dd9b34da6617fe9198c50 | | P(True) | 0.529 | Not recorded | 6a4dd9b34da6617fe9198c50 | | P(True) | 0.526 | Not recorded | 6a4dd9b34da6617fe9198c50 | | P(True) | 0.505 | Not recorded | 6a4dd9b34da6617fe9198c50 | | Verbalized Conf. | 0.498 | Not recorded | 6a4dd9b34da6617fe9198c50 | ### SPANUQ AUROC: 0.944. Result ID: 6a4df5b760b88bb339d6aff4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### SPANUQ AUROC: 0.939. Result ID: 6a4df5b760b88bb339d6afe6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction. ### SPANUQ AUROC: 0.936. Result ID: 6a4df5b760b88bb339d6affb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B-A3B"}. This record does not assert independent reproduction. ### SPANUQ AUROC: 0.93. Result ID: 6a4df5b760b88bb339d6afed. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### SPANUQ AUROC: 0.908. Result ID: 6a4df5b760b88bb339d6b002. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. ### MLP Probe AUROC: 0.893. Result ID: 6a4df5b760b88bb339d6aff6. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B-A3B","Oracle span boundaries":"true"}. This record does not assert independent reproduction. ### MLP Probe AUROC: 0.884. Result ID: 6a4df5b760b88bb339d6afe8. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B","Oracle span boundaries":"true"}. This record does not assert independent reproduction. ### MLP Probe AUROC: 0.881. Result ID: 6a4df5b760b88bb339d6afe1. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-14B","Oracle span boundaries":"true"}. This record does not assert independent reproduction. ### MLP Probe AUROC: 0.873. Result ID: 6a4df5b760b88bb339d6afef. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B","Oracle span boundaries":"true"}. This record does not assert independent reproduction. ### MLP Probe AUROC: 0.863. Result ID: 6a4df5b760b88bb339d6affd. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B","Oracle span boundaries":"true"}. This record does not assert independent reproduction. ### SelfCheckGPT-NLI AUROC: 0.816. Result ID: 6a4df5b760b88bb339d6afff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. ### SelfCheckGPT-NLI AUROC: 0.813. Result ID: 6a4df5b760b88bb339d6aff8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B-A3B"}. This record does not assert independent reproduction. ### SelfCheckGPT-NLI AUROC: 0.808. Result ID: 6a4df5b760b88bb339d6afe3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction. ### SelfCheckGPT-NLI AUROC: 0.801. Result ID: 6a4df5b760b88bb339d6afea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### SelfCheckGPT-NLI AUROC: 0.782. Result ID: 6a4df5b760b88bb339d6aff1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### FActScore AUROC: 0.762. Result ID: 6a4df5b760b88bb339d6afec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### FActScore AUROC: 0.714. Result ID: 6a4df5b760b88bb339d6aff3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### FActScore AUROC: 0.701. Result ID: 6a4df5b760b88bb339d6affa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B-A3B"}. This record does not assert independent reproduction. ### FActScore AUROC: 0.661. Result ID: 6a4df5b760b88bb339d6b001. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. ### FActScore AUROC: 0.625. Result ID: 6a4df5b760b88bb339d6afe5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction. ### Token Entropy AUROC: 0.603. Result ID: 6a4df5b760b88bb339d6afe0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction. ### Verbalized Conf. AUROC: 0.598. Result ID: 6a4df5b760b88bb339d6aff7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B-A3B"}. This record does not assert independent reproduction. ### Verbalized Conf. AUROC: 0.595. Result ID: 6a4df5b760b88bb339d6aff0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### Verbalized Conf. AUROC: 0.593. Result ID: 6a4df5b760b88bb339d6afe2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction. ### Token Entropy AUROC: 0.592. Result ID: 6a4df5b760b88bb339d6aff5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B-A3B"}. This record does not assert independent reproduction. ### Token Entropy AUROC: 0.58. Result ID: 6a4df5b760b88bb339d6afe7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### Token Entropy AUROC: 0.575. Result ID: 6a4df5b760b88bb339d6afee. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### Verbalized Conf. AUROC: 0.574. Result ID: 6a4df5b760b88bb339d6afe9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### Token Entropy AUROC: 0.569. Result ID: 6a4df5b760b88bb339d6affc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. ### P(True) AUROC: 0.546. Result ID: 6a4df5b760b88bb339d6afeb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### P(True) AUROC: 0.541. Result ID: 6a4df5b760b88bb339d6aff9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-30B-A3B"}. This record does not assert independent reproduction. ### P(True) AUROC: 0.529. Result ID: 6a4df5b760b88bb339d6aff2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-4B"}. This record does not assert independent reproduction. ### P(True) AUROC: 0.526. Result ID: 6a4df5b760b88bb339d6afe4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction. ### P(True) AUROC: 0.505. Result ID: 6a4df5b760b88bb339d6b000. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. ### Verbalized Conf. AUROC: 0.498. Result ID: 6a4df5b760b88bb339d6affe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral-7B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.