Fine-grained tag generation on Dewu note (eval)
2.678Basic Attribute Score (Total)Qwen3-VL-4B-Instruct
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-VL-4B-InstructStage=Tag Knowledge Distillation, Temperature=02026.03 | 2.678 | 0.962 | 0.959 | 0.757 | -0.029 | -0.018 | -0.033 | -0.019 | -0.047 | -0.008 | |
| InternVL3.5-4BStage=Tag Knowledge Distillation, Temperature=02026.03 | 2.669 | 0.944 | 0.954 | 0.771 | -0.057 | 0.15 | -0.055 | -0.092 | -0.112 | -0.02 | |
| Qwen3-VL-4B-InstructStage=SFT Only, Temperature=02026.03 | 2.657 | 0.973 | 0.963 | 0.721 | -0.1 | -0.064 | -0.054 | -0.042 | -0.081 | -0.061 | |
| InternVL3-2BStage=Tag Knowledge Distillation, Temperature=02026.03 | 2.654 | 0.945 | 0.958 | 0.75 | -0.341 | -0.012 | -0.302 | -0.37 | -0.42 | -0.376 | |
| Qwen3-VL-2B-InstructStage=Tag Knowledge Distillation, Temperature=02026.03 | 2.65 | 0.941 | 0.95 | 0.758 | -0.126 | -0.131 | -0.101 | -0.102 | -0.163 | -0.137 | |
| InternVL3.5-2BStage=Tag Knowledge Distillation, Temperature=02026.03 | 2.636 | 0.902 | 0.938 | 0.796 | -0.156 | -0.083 | -0.164 | -0.219 | -0.239 | -0.15 | |
| InternVL3.5-4BStage=SFT Only, Temperature=02026.03 | 2.635 | 0.958 | 0.944 | 0.733 | -0.181 | -0.135 | -0.151 | -0.143 | -0.176 | -0.186 | |
| Qwen3-VL-2B-InstructStage=SFT Only, Temperature=02026.03 | 2.635 | 0.957 | 0.945 | 0.734 | -0.216 | -0.183 | -0.157 | -0.188 | -0.216 | -0.218 | |
| InternVL3-2BStage=SFT Only, Temperature=02026.03 | 2.596 | 0.929 | 0.925 | 0.742 | -0.292 | -0.266 | -0.239 | -0.289 | -0.375 | -0.283 | |
| InternVL3.5-2BStage=SFT Only, Temperature=02026.03 | 2.596 | 0.944 | 0.932 | 0.72 | -0.271 | -0.246 | -0.193 | -0.243 | -0.278 | -0.196 | |
| Qwen3-VL-4B-InstructStage=Base MLLMs, Temperature=02026.03 | 2.432 | 0.809 | 0.781 | 0.842 | -0.637 | -0.607 | -0.791 | -0.78 | -0.715 | -0.378 | |
| InternVL3.5-2BStage=Base MLLMs, Temperature=02026.03 | 1.982 | 0.698 | 0.625 | 0.66 | -1.31 | -1.736 | -1.607 | -1.463 | -1.565 | -1.337 | |
| InternVL3-2BStage=Base MLLMs, Temperature=02026.03 | 1.935 | 0.651 | 0.531 | 0.752 | -1.38 | -1.795 | -1.747 | -1.481 | -1.622 | -1.397 | |
| Qwen3-VL-2B-InstructStage=Base MLLMs, Temperature=02026.03 | 1.412 | 0.51 | 0.396 | 0.501 | -1.657 | -1.862 | -1.952 | -1.715 | -1.837 | -1.712 |