Aesthetic Ranking on 100 monochrome non-representational line drawings Artist Ground Truth 1.0 (test)
0.8SPCCPairwise VLM Instruct
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Pairwise VLM InstructBackbone=Qwen3-VL-8B-Instruct, Reasoning prompt usage=true, Sampling level=100%2026.05 | 0.8 | 0.6 | 0 | 0.05 | 0.29 | |
| Point-wise CLIP-IQAEvaluation protocol=Point-wise2026.05 | 0.79 | 0.58 | 0 | 0.05 | 0.29 | |
| Pairwise VLM Instruct@50Backbone=Qwen3-VL-8B-Instruct, Reasoning prompt usage=true, Sampling level=50%2026.05 | 0.79 | 0.59 | 0 | 0.07 | 0.27 | |
| Pairwise VLM Instruct@20Backbone=Qwen3-VL-8B-Instruct, Reasoning prompt usage=true, Sampling level=20%2026.05 | 0.78 | 0.58 | 0.01 | 0.08 | 0.25 | |
| Pairwise VLM ThinkingBackbone=Qwen3-VL-8B-Thinking, Reasoning prompt usage=true, Sampling level=100%2026.05 | 0.76 | 0.55 | 0 | 0.11 | 0.33 | |
| Pairwise VLM Instruct@10Backbone=Qwen3-VL-8B-Instruct, Reasoning prompt usage=true, Sampling level=10%2026.05 | 0.75 | 0.55 | 0.02 | 0.1 | 0.24 | |
| Pairwise VLM Instruct w/out Reasoning PromptBackbone=Qwen3-VL-8B-Instruct, Reasoning prompt usage=false, Sampling level=100%2026.05 | 0.64 | 0.45 | 0 | 0 | 0.03 | |
| MC ComplexityMethod Type=Traditional Proxy2026.05 | 0.43 | 0.27 | 0 | 0 | 0.05 | |
| Structural ComplexityMethod Type=Traditional Proxy2026.05 | 0.36 | 0.22 | 0 | 0 | 0.05 | |
| Fractal ComplexityMethod Type=Traditional Proxy2026.05 | 0.07 | 0.08 | 0 | 0 | 0.03 | |
| Fractal DimensionsMethod Type=Traditional Proxy2026.05 | 0.06 | 0.09 | 0 | 0 | 0.03 |