Closed-ended Task T-1 on DanmakuTPP-QA
27.33AccuracyMM-TPP
Evaluation results
| Method | Links | |
|---|---|---|
| MM-TPPModel Category=Finetuned2026.02 | 27.33 | |
| Qwen2.5-VL-3BModel Category=Finetuned2026.02 | 27 | |
| Qwen2.5-32B-InstructModel Category=LLMs2026.02 | 25.33 | |
| DeepSeek-V3Model Category=LLMs2026.02 | 25 | |
| Qwen2.5-VL-7BModel Category=MLLMs2026.02 | 9.67 | |
| Qwen3-235B-A22BModel Category=LLMs2026.02 | 8.67 | |
| Qwen2.5-VL-32BModel Category=MLLMs2026.02 | 8 | |
| Qwen3-8BModel Category=LLMs2026.02 | 6.67 | |
| Llama-3.3-70B-InstructModel Category=LLMs2026.02 | 1.67 | |
| Qwen2.5-72B-InstructModel Category=LLMs2026.02 | 0.67 | |
| Qwen3-30B-A3BModel Category=LLMs2026.02 | 0.67 | |
| Qwen2.5-7B-InstructModel Category=LLMs2026.02 | 0.33 | |
| Qwen2.5-VL-72BModel Category=MLLMs2026.02 | 0.33 | |
| Gemma3-27BModel Category=MLLMs2026.02 | 0.33 |