# Translation on Copyrighted Content without copyright notice 1.0 (test) Source: [Translation on Copyrighted Content without copyright notice 1.0 (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:39:56.368Z Evaluation of Translation performance on the test split of the Copyrighted Content without copyright notice 1.0 dataset, measured using Cosine Similarity (CosSim) and Refusal rate. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Translation | | Dataset (including any stated split) | Copyrighted Content without copyright notice 1.0 (test) | | Metric | Cosine Similarity | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 12 of 12 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Cosine Similarity](): Higher is better; unit: PERCENT. - [Refusal Rate](): Lower is better; unit: PERCENT. ## Recorded results | Method | Cosine Similarity | Result date | Report paper | | --- | --- | --- | --- | | Gemini-2.0 | 44.84 | Not recorded | 69520adb53fdd5c36173d379 | | LLaVA-NeXT\_13B | 44.22 | Not recorded | 69520adb53fdd5c36173d379 | | GLM-4v\_9B | 44.05 | Not recorded | 69520adb53fdd5c36173d379 | | Claude-3.7 | 39.21 | Not recorded | 69520adb53fdd5c36173d379 | | Qwen2.5-VL\_7B | 38.73 | Not recorded | 69520adb53fdd5c36173d379 | | Qwen2.5-VL\_3B | 38.59 | Not recorded | 69520adb53fdd5c36173d379 | | Janus-Pro\_7B | 36.63 | Not recorded | 69520adb53fdd5c36173d379 | | DeepSeek-VL\_7B | 36.4 | Not recorded | 69520adb53fdd5c36173d379 | | GPT-4o-mini | 33.96 | Not recorded | 69520adb53fdd5c36173d379 | | LLaVA-1.5\_13B | 29.85 | Not recorded | 69520adb53fdd5c36173d379 | | LLaVA-1.5\_7B | 27.07 | Not recorded | 69520adb53fdd5c36173d379 | | GPT-4o | 9.78 | Not recorded | 69520adb53fdd5c36173d379 | ### Gemini-2.0 Cosine Similarity: 44.84. Result ID: 6996af165698665ec4f9423e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Availability":"API-based"}. This record does not assert independent reproduction. ### LLaVA-NeXT\_13B Cosine Similarity: 44.22. Result ID: 6996af165698665ec4f94242. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"13B"}. This record does not assert independent reproduction. ### GLM-4v\_9B Cosine Similarity: 44.05. Result ID: 6996af165698665ec4f94246. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"9B"}. This record does not assert independent reproduction. ### Claude-3.7 Cosine Similarity: 39.21. Result ID: 6996af165698665ec4f9423f. [Reporting paper]() Recorded evaluation configuration: {"Availability":"API-based"}. This record does not assert independent reproduction. ### Qwen2.5-VL\_7B Cosine Similarity: 38.73. Result ID: 6996af165698665ec4f94244. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"7B"}. This record does not assert independent reproduction. ### Qwen2.5-VL\_3B Cosine Similarity: 38.59. Result ID: 6996af165698665ec4f94243. [Reporting paper]() Recorded evaluation configuration: {"Parameters":"3B"}. This record does not assert independent reproduction. ### Janus-Pro\_7B Cosine Similarity: 36.63. Result ID: 6996af165698665ec4f94247. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"7B"}. This record does not assert independent reproduction. ### DeepSeek-VL\_7B Cosine Similarity: 36.4. Result ID: 6996af165698665ec4f94245. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"7B"}. This record does not assert independent reproduction. ### GPT-4o-mini Cosine Similarity: 33.96. Result ID: 6996af165698665ec4f9423c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Availability":"API-based"}. This record does not assert independent reproduction. ### LLaVA-1.5\_13B Cosine Similarity: 29.85. Result ID: 6996af165698665ec4f94241. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"13B"}. This record does not assert independent reproduction. ### LLaVA-1.5\_7B Cosine Similarity: 27.07. Result ID: 6996af165698665ec4f94240. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Parameters":"7B"}. This record does not assert independent reproduction. ### GPT-4o Cosine Similarity: 9.78. Result ID: 6996af165698665ec4f9423d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Availability":"API-based"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.