Extraction on Copyrighted Content without copyright notice 1.0 (test)
94.5ROUGE ScoreGemini-2.0
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemini-2.0Availability=API-based2025.12 | 94.5 | 1.25 | |
| Qwen2.5-VL_3BParameters=3B2025.12 | 83.81 | 1.85 | |
| GPT-4o-miniAvailability=API-based2025.12 | 83.25 | 2.1 | |
| Qwen2.5-VL_7BParameters=7B2025.12 | 76.53 | 2.39 | |
| LLaVA-NeXT_13BParameters=13B2025.12 | 72.31 | 2.4 | |
| LLaVA-1.5_7BParameters=7B2025.12 | 67.45 | 2.15 | |
| LLaVA-1.5_13BParameters=13B2025.12 | 67.26 | 3.72 | |
| Janus-Pro_7BParameters=7B2025.12 | 64.9 | 2.63 | |
| GLM-4v_9BParameters=9B2025.12 | 64.68 | 2.92 | |
| Claude-3.7Availability=API-based2025.12 | 64.09 | 0.03 | |
| DeepSeek-VL_7BParameters=7B2025.12 | 54.87 | 2.62 | |
| GPT-4oAvailability=API-based2025.12 | 52.06 | 52.78 |