# Uncertainty Quantification on ArabicaQA Source: [Uncertainty Quantification on ArabicaQA]() Collection index: [llms.txt]() Data updated: 2026-06-11T06:44:57.005Z Evaluation of model performance on Uncertainty Quantification using the ArabicaQA dataset, measured using metrics like AUROC. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Uncertainty Quantification | | Dataset (including any stated split) | ArabicaQA | | Metric | AUROC | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 36 of 36 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [AUROC](): Higher is better; unit: SCALAR. - [PRR](): Higher is better; unit: SCALAR. ## Recorded results | Method | AUROC | Result date | Report paper | | --- | --- | --- | --- | | P(true) | 0.711 | Not recorded | 6a28f33c90966ade919c16f5 | | LogProb | 0.689 | Not recorded | 6a28f33c90966ade919c16f5 | | GLU-AU | 0.65 | Not recorded | 6a28f33c90966ade919c16f5 | | GLU | 0.647 | Not recorded | 6a28f33c90966ade919c16f5 | | RAUQ | 0.642 | Not recorded | 6a28f33c90966ade919c16f5 | | LogProb | 0.625 | Not recorded | 6a28f33c90966ade919c16f5 | | LogProb | 0.619 | Not recorded | 6a28f33c90966ade919c16f5 | | RAUQ | 0.613 | Not recorded | 6a28f33c90966ade919c16f5 | | RAUQ | 0.61 | Not recorded | 6a28f33c90966ade919c16f5 | | P(true) | 0.597 | Not recorded | 6a28f33c90966ade919c16f5 | | P(true) | 0.594 | Not recorded | 6a28f33c90966ade919c16f5 | | GLU-AU | 0.586 | Not recorded | 6a28f33c90966ade919c16f5 | | GLU | 0.563 | Not recorded | 6a28f33c90966ade919c16f5 | | GLU-AU | 0.562 | Not recorded | 6a28f33c90966ade919c16f5 | | GLU | 0.556 | Not recorded | 6a28f33c90966ade919c16f5 | | LogTokU | 0.538 | Not recorded | 6a28f33c90966ade919c16f5 | | LogTokU | 0.521 | Not recorded | 6a28f33c90966ade919c16f5 | | LogTokU | 0.49 | Not recorded | 6a28f33c90966ade919c16f5 | ### P(true) AUROC: 0.711. Result ID: 6a2a5959fbc373592c26cbf8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### LogProb AUROC: 0.689. Result ID: 6a2a5959fbc373592c26cbfd. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemma"}. This record does not assert independent reproduction. ### GLU-AU AUROC: 0.65. Result ID: 6a2a5959fbc373592c26cc00. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma"}. This record does not assert independent reproduction. ### GLU AUROC: 0.647. Result ID: 6a2a5959fbc373592c26cbff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma"}. This record does not assert independent reproduction. ### RAUQ AUROC: 0.642. Result ID: 6a2a5959fbc373592c26cbfc. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemma"}. This record does not assert independent reproduction. ### LogProb AUROC: 0.625. Result ID: 6a2a5959fbc373592c26cbf7. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### LogProb AUROC: 0.619. Result ID: 6a2a5959fbc373592c26cc03. [Reporting paper]() Recorded evaluation configuration: {"Model":"Fanar"}. This record does not assert independent reproduction. ### RAUQ AUROC: 0.613. Result ID: 6a2a5959fbc373592c26cc02. [Reporting paper]() Recorded evaluation configuration: {"Model":"Fanar"}. This record does not assert independent reproduction. ### RAUQ AUROC: 0.61. Result ID: 6a2a5959fbc373592c26cbf6. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### P(true) AUROC: 0.597. Result ID: 6a2a5959fbc373592c26cbfe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma"}. This record does not assert independent reproduction. ### P(true) AUROC: 0.594. Result ID: 6a2a5959fbc373592c26cc04. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Fanar"}. This record does not assert independent reproduction. ### GLU-AU AUROC: 0.586. Result ID: 6a2a5959fbc373592c26cc06. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Fanar"}. This record does not assert independent reproduction. ### GLU AUROC: 0.563. Result ID: 6a2a5959fbc373592c26cc05. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Fanar"}. This record does not assert independent reproduction. ### GLU-AU AUROC: 0.562. Result ID: 6a2a5959fbc373592c26cbfa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### GLU AUROC: 0.556. Result ID: 6a2a5959fbc373592c26cbf9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### LogTokU AUROC: 0.538. Result ID: 6a2a5959fbc373592c26cbfb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemma"}. This record does not assert independent reproduction. ### LogTokU AUROC: 0.521. Result ID: 6a2a5959fbc373592c26cbf5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### LogTokU AUROC: 0.49. Result ID: 6a2a5959fbc373592c26cc01. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Fanar"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.