# Pairwise Preference Prediction on DyCoBench-1K Overall Preference Source: [Pairwise Preference Prediction on DyCoBench-1K Overall Preference]() Collection index: [llms.txt]() Data updated: 2026-05-26T12:53:28.803Z Evaluation of model performance on predicting pairwise preferences using the Overall Preference setting of the DyCoBench-1K dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Pairwise Preference Prediction | | Dataset (including any stated split) | DyCoBench-1K Overall Preference | | Metric | Preference Rate (A \> B) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Preference Rate (A \> B)](): Higher is better; unit: PERCENT. - [Preference Rate (A \< B)](): Higher is better; unit: PERCENT. - [Preference Rate (A = B)](): Higher is better; unit: PERCENT. - [Average Preference Rate](): Higher is better; unit: PERCENT. ## Recorded results | Method | Preference Rate (A \> B) | Result date | Report paper | | --- | --- | --- | --- | | DYCORM(OURS) | 78.3 | Not recorded | 6a152976dbd7150506f7e405 | | HPSV3 | 72.8 | Not recorded | 6a152976dbd7150506f7e405 | | HPSV2 | 71.2 | Not recorded | 6a152976dbd7150506f7e405 | | MPS | 70.8 | Not recorded | 6a152976dbd7150506f7e405 | | IMAGEREWARD | 66.8 | Not recorded | 6a152976dbd7150506f7e405 | | PICKSCORE | 65.5 | Not recorded | 6a152976dbd7150506f7e405 | | HPS | 65.3 | Not recorded | 6a152976dbd7150506f7e405 | | GPT-5 (25-08-07) | 65.1 | Not recorded | 6a152976dbd7150506f7e405 | | GEMINI-3.0-PRO | 64.7 | Not recorded | 6a152976dbd7150506f7e405 | | GPT-4O (24-11-20) | 64 | Not recorded | 6a152976dbd7150506f7e405 | | AESTHETIC SCORE PREDICTOR | 63.5 | Not recorded | 6a152976dbd7150506f7e405 | | CLIPSCORE | 63.2 | Not recorded | 6a152976dbd7150506f7e405 | | INTERNVL3.5-14B | 61.2 | Not recorded | 6a152976dbd7150506f7e405 | | QWEN3VL-8B | 60.4 | Not recorded | 6a152976dbd7150506f7e405 | | INTERNVL3.5-8B | 59.8 | Not recorded | 6a152976dbd7150506f7e405 | | LLAVA-ONEVISION-1.5-7B | 59.6 | Not recorded | 6a152976dbd7150506f7e405 | | QWEN3VL-4B | 59.3 | Not recorded | 6a152976dbd7150506f7e405 | ### DYCORM(OURS) Preference Rate (A \> B): 78.3. Result ID: 6a1597bbfbc373592c0e775a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Reward Models"}. This record does not assert independent reproduction. ### HPSV3 Preference Rate (A \> B): 72.8. Result ID: 6a1597bbfbc373592c0e7759. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Reward Models"}. This record does not assert independent reproduction. ### HPSV2 Preference Rate (A \> B): 71.2. Result ID: 6a1597bbfbc373592c0e7757. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Reward Models"}. This record does not assert independent reproduction. ### MPS Preference Rate (A \> B): 70.8. Result ID: 6a1597bbfbc373592c0e7758. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"Reward Models"}. This record does not assert independent reproduction. ### IMAGEREWARD Preference Rate (A \> B): 66.8. Result ID: 6a1597bbfbc373592c0e7754. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"Reward Models"}. This record does not assert independent reproduction. ### PICKSCORE Preference Rate (A \> B): 65.5. Result ID: 6a1597bbfbc373592c0e7755. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"Reward Models"}. This record does not assert independent reproduction. ### HPS Preference Rate (A \> B): 65.3. Result ID: 6a1597bbfbc373592c0e7756. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Reward Models"}. This record does not assert independent reproduction. ### GPT-5 (25-08-07) Preference Rate (A \> B): 65.1. Result ID: 6a1597bbfbc373592c0e7750. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"General LMMs"}. This record does not assert independent reproduction. ### GEMINI-3.0-PRO Preference Rate (A \> B): 64.7. Result ID: 6a1597bbfbc373592c0e7751. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"General LMMs"}. This record does not assert independent reproduction. ### GPT-4O (24-11-20) Preference Rate (A \> B): 64. Result ID: 6a1597bbfbc373592c0e774f. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"General LMMs"}. This record does not assert independent reproduction. ### AESTHETIC SCORE PREDICTOR Preference Rate (A \> B): 63.5. Result ID: 6a1597bbfbc373592c0e7753. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"Reward Models"}. This record does not assert independent reproduction. ### CLIPSCORE Preference Rate (A \> B): 63.2. Result ID: 6a1597bbfbc373592c0e7752. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"Reward Models"}. This record does not assert independent reproduction. ### INTERNVL3.5-14B Preference Rate (A \> B): 61.2. Result ID: 6a1597bbfbc373592c0e774b. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"General LMMs"}. This record does not assert independent reproduction. ### QWEN3VL-8B Preference Rate (A \> B): 60.4. Result ID: 6a1597bbfbc373592c0e774d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"General LMMs"}. This record does not assert independent reproduction. ### INTERNVL3.5-8B Preference Rate (A \> B): 59.8. Result ID: 6a1597bbfbc373592c0e774a. [Reporting paper]() Recorded evaluation configuration: {"Model Category":"General LMMs"}. This record does not assert independent reproduction. ### LLAVA-ONEVISION-1.5-7B Preference Rate (A \> B): 59.6. Result ID: 6a1597bbfbc373592c0e774e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Category":"General LMMs"}. This record does not assert independent reproduction. ### QWEN3VL-4B Preference Rate (A \> B): 59.3. Result ID: 6a1597bbfbc373592c0e774c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Category":"General LMMs"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.