# Correctness Assessment on UltraFeedback Property Constraints Satisfaction (test) Source: [Correctness Assessment on UltraFeedback Property Constraints Satisfaction (test)]() Collection index: [llms.txt]() Data updated: 2026-04-02T09:23:24.086Z Evaluation of model correctness assessment capabilities on the UltraFeedback Property Constraints Satisfaction test set, focusing on worst-case size distortion metrics related to instruction following and truthfulness. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Correctness Assessment | | Dataset (including any stated split) | UltraFeedback Property Constraints Satisfaction (test) | | Metric | Worst-case Size Distortion (Helpfulness & Instruction-following) | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 9 of 9 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Worst-case Size Distortion (Helpfulness & Instruction-following)](): Lower is better; unit: SCALAR. - [Worst-case Size Distortion (Honesty & Truthfulness)](): Lower is better; unit: SCALAR. ## Recorded results | Method | Worst-case Size Distortion (Helpfulness & Instruction-following) | Result date | Report paper | | --- | --- | --- | --- | | naive (1) | 0.07 | Not recorded | 6902f1013ef7ccd74e5e4436 | | e-score (2) | 0.8 | Not recorded | 6902f1013ef7ccd74e5e4436 | | e-score (combined) | 0.94 | Not recorded | 6902f1013ef7ccd74e5e4436 | | e-score (1) | 1 | Not recorded | 6902f1013ef7ccd74e5e4436 | | e-score (3) | 1 | Not recorded | 6902f1013ef7ccd74e5e4436 | | naive (3) | 1.8 | Not recorded | 6902f1013ef7ccd74e5e4436 | | naive (2) | 2.25 | Not recorded | 6902f1013ef7ccd74e5e4436 | | p-score | 9.6 | Not recorded | 6902f1013ef7ccd74e5e4436 | | p-score (randomized) | 15.91 | Not recorded | 6902f1013ef7ccd74e5e4436 | ### naive (1) Worst-case Size Distortion (Helpfulness & Instruction-following): 0.07. Result ID: 69ce358847f34ce924b7a7ce. [Reporting paper]() Recorded evaluation configuration: {"Score":"naive (1)"}. This record does not assert independent reproduction. ### e-score (2) Worst-case Size Distortion (Helpfulness & Instruction-following): 0.8. Result ID: 69ce358847f34ce924b7a7d4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Score":"e-score (2)"}. This record does not assert independent reproduction. ### e-score (combined) Worst-case Size Distortion (Helpfulness & Instruction-following): 0.94. Result ID: 69ce358847f34ce924b7a7d6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Score":"e-score (combined)"}. This record does not assert independent reproduction. ### e-score (1) Worst-case Size Distortion (Helpfulness & Instruction-following): 1. Result ID: 69ce358847f34ce924b7a7d3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Score":"e-score (1)"}. This record does not assert independent reproduction. ### e-score (3) Worst-case Size Distortion (Helpfulness & Instruction-following): 1. Result ID: 69ce358847f34ce924b7a7d5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Score":"e-score (3)"}. This record does not assert independent reproduction. ### naive (3) Worst-case Size Distortion (Helpfulness & Instruction-following): 1.8. Result ID: 69ce358847f34ce924b7a7d0. [Reporting paper]() Recorded evaluation configuration: {"Score":"naive (3)"}. This record does not assert independent reproduction. ### naive (2) Worst-case Size Distortion (Helpfulness & Instruction-following): 2.25. Result ID: 69ce358847f34ce924b7a7cf. [Reporting paper]() Recorded evaluation configuration: {"Score":"naive (2)"}. This record does not assert independent reproduction. ### p-score Worst-case Size Distortion (Helpfulness & Instruction-following): 9.6. Result ID: 69ce358847f34ce924b7a7d1. [Reporting paper]() Recorded evaluation configuration: {"Score":"p-score"}. This record does not assert independent reproduction. ### p-score (randomized) Worst-case Size Distortion (Helpfulness & Instruction-following): 15.91. Result ID: 69ce358847f34ce924b7a7d2. [Reporting paper]() Recorded evaluation configuration: {"Score":"p-score (randomized)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.