# Extraction on Copyrighted Content without copyright notice 1.0 (test) Source: [Extraction on Copyrighted Content without copyright notice 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:00:31.400Z Evaluation of Extraction performance on the test split of the Copyrighted Content without copyright notice 1.0 dataset, measured using ROUGE and Refusal rates. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Extraction | | Dataset (including any stated split) | Copyrighted Content without copyright notice 1.0 (test) | | Metric | ROUGE Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [ROUGE Score](): Higher is better; unit: PERCENT. - [Refusal Rate](): Lower is better; unit: PERCENT. ## Recorded results | Method | ROUGE Score | Result date | Report paper | | --- | --- | --- | --- | | Gemini-2.0 | 94.5 | Not recorded | 69520adb53fdd5c36173d379 | | Qwen2.5-VL\_3B | 83.81 | Not recorded | 69520adb53fdd5c36173d379 | | GPT-4o-mini | 83.25 | Not recorded | 69520adb53fdd5c36173d379 | | Qwen2.5-VL\_7B | 76.53 | Not recorded | 69520adb53fdd5c36173d379 | | LLaVA-NeXT\_13B | 72.31 | Not recorded | 69520adb53fdd5c36173d379 | | LLaVA-1.5\_7B | 67.45 | Not recorded | 69520adb53fdd5c36173d379 | | LLaVA-1.5\_13B | 67.26 | Not recorded | 69520adb53fdd5c36173d379 | | Janus-Pro\_7B | 64.9 | Not recorded | 69520adb53fdd5c36173d379 | | GLM-4v\_9B | 64.68 | Not recorded | 69520adb53fdd5c36173d379 | | Claude-3.7 | 64.09 | Not recorded | 69520adb53fdd5c36173d379 | | DeepSeek-VL\_7B | 54.87 | Not recorded | 69520adb53fdd5c36173d379 | | GPT-4o | 52.06 | Not recorded | 69520adb53fdd5c36173d379 | ### Gemini-2.0 ROUGE Score: 94.5. Result ID: 6996af165698665ec4f94226. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Availability":"API-based"}. This record does not assert independent reproduction. ### Qwen2.5-VL\_3B ROUGE Score: 83.81. Result ID: 6996af165698665ec4f9422b. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"3B"}. This record does not assert independent reproduction. ### GPT-4o-mini ROUGE Score: 83.25. Result ID: 6996af165698665ec4f94224. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Availability":"API-based"}. This record does not assert independent reproduction. ### Qwen2.5-VL\_7B ROUGE Score: 76.53. Result ID: 6996af165698665ec4f9422c. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"7B"}. This record does not assert independent reproduction. ### LLaVA-NeXT\_13B ROUGE Score: 72.31. Result ID: 6996af165698665ec4f9422a. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"13B"}. This record does not assert independent reproduction. ### LLaVA-1.5\_7B ROUGE Score: 67.45. Result ID: 6996af165698665ec4f94228. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"7B"}. This record does not assert independent reproduction. ### LLaVA-1.5\_13B ROUGE Score: 67.26. Result ID: 6996af165698665ec4f94229. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"13B"}. This record does not assert independent reproduction. ### Janus-Pro\_7B ROUGE Score: 64.9. Result ID: 6996af165698665ec4f9422f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"7B"}. This record does not assert independent reproduction. ### GLM-4v\_9B ROUGE Score: 64.68. Result ID: 6996af165698665ec4f9422e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"9B"}. This record does not assert independent reproduction. ### Claude-3.7 ROUGE Score: 64.09. Result ID: 6996af165698665ec4f94227. [Reporting paper]() Recorded evaluation configuration: {"Availability":"API-based"}. This record does not assert independent reproduction. ### DeepSeek-VL\_7B ROUGE Score: 54.87. Result ID: 6996af165698665ec4f9422d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"7B"}. This record does not assert independent reproduction. ### GPT-4o ROUGE Score: 52.06. Result ID: 6996af165698665ec4f94225. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Availability":"API-based"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.