# Generation on VPTT-Bench 1.0 (test) Source: [Generation on VPTT-Bench 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:08:03.303Z Evaluation of generation performance using the test split of VPTT-Bench version 1.0, assessed using novelty-adjusted VPTT score and Cohen's d. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Generation | | Dataset (including any stated split) | VPTT-Bench 1.0 (test) | | Metric | VPTT Score (Novelty Adjusted) | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 15 of 15 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [VPTT Score (Novelty Adjusted)](): Higher is better; unit: SCALAR. - [Cohen's d](): Higher is better; unit: SCALAR. ## Recorded results | Method | VPTT Score (Novelty Adjusted) | Result date | Report paper | | --- | --- | --- | --- | | Comb. (BRAG + VPRAG) | 0.644 | Not recorded | 69802f6ca8b01e76cc8e14fb | | VPRAG | 0.64 | Not recorded | 69802f6ca8b01e76cc8e14fb | | Comb. (BRAG + VPRAG) | 0.632 | Not recorded | 69802f6ca8b01e76cc8e14fb | | VPRAG | 0.631 | Not recorded | 69802f6ca8b01e76cc8e14fb | | BRAG | 0.628 | Not recorded | 69802f6ca8b01e76cc8e14fb | | VPRAG | 0.625 | Not recorded | 69802f6ca8b01e76cc8e14fb | | BRAG | 0.616 | Not recorded | 69802f6ca8b01e76cc8e14fb | | Comb. (BRAG + VPRAG) | 0.602 | Not recorded | 69802f6ca8b01e76cc8e14fb | | BRAG | 0.581 | Not recorded | 69802f6ca8b01e76cc8e14fb | | Persona Only | 0.402 | Not recorded | 69802f6ca8b01e76cc8e14fb | | Persona Only | 0.389 | Not recorded | 69802f6ca8b01e76cc8e14fb | | Persona Only | 0.379 | Not recorded | 69802f6ca8b01e76cc8e14fb | | Baseline | 0.316 | Not recorded | 69802f6ca8b01e76cc8e14fb | | Baseline | 0.316 | Not recorded | 69802f6ca8b01e76cc8e14fb | | Baseline | 0.316 | Not recorded | 69802f6ca8b01e76cc8e14fb | ### Comb. (BRAG + VPRAG) VPTT Score (Novelty Adjusted): 0.644. Result ID: 6997729e5698665ec4c6ad98. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"4o-mini"}. This record does not assert independent reproduction. ### VPRAG VPTT Score (Novelty Adjusted): 0.64. Result ID: 6997729e5698665ec4c6ad97. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"4o-mini"}. This record does not assert independent reproduction. ### Comb. (BRAG + VPRAG) VPTT Score (Novelty Adjusted): 0.632. Result ID: 6997729e5698665ec4c6ad9d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini"}. This record does not assert independent reproduction. ### VPRAG VPTT Score (Novelty Adjusted): 0.631. Result ID: 6997729e5698665ec4c6ad92. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### BRAG VPTT Score (Novelty Adjusted): 0.628. Result ID: 6997729e5698665ec4c6ad96. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"4o-mini"}. This record does not assert independent reproduction. ### VPRAG VPTT Score (Novelty Adjusted): 0.625. Result ID: 6997729e5698665ec4c6ad9c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Gemini"}. This record does not assert independent reproduction. ### BRAG VPTT Score (Novelty Adjusted): 0.616. Result ID: 6997729e5698665ec4c6ad9b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Gemini"}. This record does not assert independent reproduction. ### Comb. (BRAG + VPRAG) VPTT Score (Novelty Adjusted): 0.602. Result ID: 6997729e5698665ec4c6ad93. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### BRAG VPTT Score (Novelty Adjusted): 0.581. Result ID: 6997729e5698665ec4c6ad91. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### Persona Only VPTT Score (Novelty Adjusted): 0.402. Result ID: 6997729e5698665ec4c6ad95. [Reporting paper]() Recorded evaluation configuration: {"Model":"4o-mini"}. This record does not assert independent reproduction. ### Persona Only VPTT Score (Novelty Adjusted): 0.389. Result ID: 6997729e5698665ec4c6ad90. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### Persona Only VPTT Score (Novelty Adjusted): 0.379. Result ID: 6997729e5698665ec4c6ad9a. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemini"}. This record does not assert independent reproduction. ### Baseline VPTT Score (Novelty Adjusted): 0.316. Result ID: 6997729e5698665ec4c6ad8f. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen"}. This record does not assert independent reproduction. ### Baseline VPTT Score (Novelty Adjusted): 0.316. Result ID: 6997729e5698665ec4c6ad94. [Reporting paper]() Recorded evaluation configuration: {"Model":"4o-mini"}. This record does not assert independent reproduction. ### Baseline VPTT Score (Novelty Adjusted): 0.316. Result ID: 6997729e5698665ec4c6ad99. [Reporting paper]() Recorded evaluation configuration: {"Model":"Gemini"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.