Repetition on Copyrighted Content without copyright notice 1.0 (test)
94.12ROUGE ScoreQwen2.5-VL_7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-VL_7BBackbone=Qwen2.5-VL, Parameters=7B2025.12 | 94.12 | 2.35 | |
| Qwen2.5-VL_3BBackbone=Qwen2.5-VL, Parameters=3B2025.12 | 93.81 | 4.23 | |
| GLM-4v_9BBackbone=GLM-4v, Parameters=9B2025.12 | 91.3 | 4.78 | |
| Claude-3.7Availability=API-based2025.12 | 74.84 | 21.86 | |
| LLaVA-NeXT_13BBackbone=LLaVA-NeXT, Parameters=13B2025.12 | 69.34 | 5.76 | |
| DeepSeek-VL_7BBackbone=DeepSeek-VL, Parameters=7B2025.12 | 61.28 | 2.93 | |
| Janus-Pro_7BBackbone=Janus-Pro, Parameters=7B2025.12 | 53.8 | 1.86 | |
| Gemini-2.0Availability=API-based2025.12 | 48.88 | 0.09 | |
| LLaVA-1.5_13BBackbone=LLaVA-1.5, Parameters=13B2025.12 | 42.52 | 10.39 | |
| GPT-4o-miniAvailability=API-based2025.12 | 42.07 | 69.31 | |
| LLaVA-1.5_7BBackbone=LLaVA-1.5, Parameters=7B2025.12 | 41.07 | 11.12 | |
| GPT-4oAvailability=API-based2025.12 | 38.51 | 90.65 |