# Video Generation on V-RAGBench Source: [Video Generation on V-RAGBench]() Collection index: [llms.txt]() Data updated: 2026-06-12T07:47:37.601Z Evaluation of video generation models on the V-RAGBench dataset, specifically assessing performance using pass rate metrics derived from evaluations conducted by Qwen3-VL and Gemma models. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Video Generation | | Dataset (including any stated split) | V-RAGBench | | Metric | Pass Rate (Qwen3-VL-8B) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 10 of 10 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Pass Rate (Qwen3-VL-8B)](): Higher is better; unit: PERCENT. - [Pass Rate (Qwen3-VL-32B)](): Higher is better; unit: PERCENT. - [Pass Rate (Gemma-4-26B)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Pass Rate (Qwen3-VL-8B) | Result date | Report paper | | --- | --- | --- | --- | | CARVE | 35.7 | Not recorded | 6a2b92c5d33dfb23e783b240 | | VideoRAG-B | 31.5 | Not recorded | 6a2b92c5d33dfb23e783b240 | | UniversalRAG | 29.3 | Not recorded | 6a2b92c5d33dfb23e783b240 | | GME | 26 | Not recorded | 6a2b92c5d33dfb23e783b240 | | VideoRAG-A | 25 | Not recorded | 6a2b92c5d33dfb23e783b240 | | UniversalRAG-LoRA | 23.7 | Not recorded | 6a2b92c5d33dfb23e783b240 | | Freeret | 22.5 | Not recorded | 6a2b92c5d33dfb23e783b240 | | DAT | 22.3 | Not recorded | 6a2b92c5d33dfb23e783b240 | | RRF | 18 | Not recorded | 6a2b92c5d33dfb23e783b240 | | GQR | 16.7 | Not recorded | 6a2b92c5d33dfb23e783b240 | ### CARVE Pass Rate (Qwen3-VL-8B): 35.7. Result ID: 6a2bb893fbc373592c29d96b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Chunk-Level"}. This record does not assert independent reproduction. ### VideoRAG-B Pass Rate (Qwen3-VL-8B): 31.5. Result ID: 6a2bb893fbc373592c29d968. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Category":"Query-Level"}. This record does not assert independent reproduction. ### UniversalRAG Pass Rate (Qwen3-VL-8B): 29.3. Result ID: 6a2bb893fbc373592c29d969. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Query-Level"}. This record does not assert independent reproduction. ### GME Pass Rate (Qwen3-VL-8B): 26. Result ID: 6a2bb893fbc373592c29d965. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"System-Level"}. This record does not assert independent reproduction. ### VideoRAG-A Pass Rate (Qwen3-VL-8B): 25. Result ID: 6a2bb893fbc373592c29d962. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"System-Level"}. This record does not assert independent reproduction. ### UniversalRAG-LoRA Pass Rate (Qwen3-VL-8B): 23.7. Result ID: 6a2bb893fbc373592c29d96a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Query-Level"}. This record does not assert independent reproduction. ### Freeret Pass Rate (Qwen3-VL-8B): 22.5. Result ID: 6a2bb893fbc373592c29d964. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"System-Level"}. This record does not assert independent reproduction. ### DAT Pass Rate (Qwen3-VL-8B): 22.3. Result ID: 6a2bb893fbc373592c29d967. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Query-Level"}. This record does not assert independent reproduction. ### RRF Pass Rate (Qwen3-VL-8B): 18. Result ID: 6a2bb893fbc373592c29d966. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"Query-Level"}. This record does not assert independent reproduction. ### GQR Pass Rate (Qwen3-VL-8B): 16.7. Result ID: 6a2bb893fbc373592c29d963. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Category":"System-Level"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.