Aesthetic Classification on A3-Dataset
87Image FidelityA3-Align
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| A3-AlignModel Category=Ours, Thinking Mode=false2026.03 | 87 | 82.4 | 91.7 | 82.4 | 88 | 87 | 99.1 | 92.6 | |
| Gemini 2.5 pro-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 77.8 | 65.7 | 75.9 | 80.6 | 50 | 68.5 | 89.8 | 47.2 | |
| Gemini 2.5 proModel Category=Closed-source Models, Thinking Mode=false2026.03 | 75 | 73.2 | 80.6 | 80.6 | 50.9 | 75 | 87 | 46.3 | |
| Gemini 2.5 flash-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 69.2 | 57 | 69.4 | 73.6 | 44.3 | 56.1 | 80.2 | 16 | |
| Gemini 2.5 flashModel Category=Closed-source Models, Thinking Mode=false2026.03 | 66.7 | 53.1 | 70.8 | 63.3 | 47.3 | 56.8 | 68 | 14 | |
| Gemma-3-27B-itModel Category=Open-source Models, Thinking Mode=false2026.03 | 64.8 | 57.4 | 72.2 | 63.9 | 58.3 | 69.4 | 66.7 | 33.3 | |
| Qwen3-VL-32B-InstructModel Category=Open-source Models, Thinking Mode=false2026.03 | 60.2 | 58.3 | 51.8 | 69.4 | 57.4 | 48.2 | 88 | 25.9 | |
| Claude Haiku 4.5-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 56.5 | 62 | 62.6 | 73.2 | 48.2 | 54.6 | 88.9 | 39.8 | |
| Qwen3-VL-32B-thinkingModel Category=Open-source Models - Thinking, Thinking Mode=true2026.03 | 55.6 | 48.1 | 48.1 | 67.6 | 50 | 48.1 | 87 | 22.2 | |
| Claude Haiku 4.5Model Category=Closed-source Models, Thinking Mode=false2026.03 | 55.6 | 63.9 | 58.9 | 77.8 | 50.9 | 53.7 | 84.3 | 40.7 | |
| Claude Sonnet 4.5-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 55.6 | 54.6 | 68.9 | 75.7 | 57.4 | 62.6 | 81.5 | 47.2 | |
| Llama-4-Scout-109BModel Category=Open-source Models, Thinking Mode=false2026.03 | 54.6 | 54.6 | 49.1 | 54.6 | 47.2 | 51.9 | 69.4 | 41.7 | |
| Qwen3-VL-235B-A22B-thinkingModel Category=Open-source Models - Thinking, Thinking Mode=true2026.03 | 54.6 | 60.2 | 63 | 74.1 | 63 | 63.9 | 76.9 | 12 | |
| Claude Sonnet 4.5Model Category=Closed-source Models, Thinking Mode=false2026.03 | 54.6 | 52.8 | 60.8 | 73.2 | 61.1 | 56.1 | 82.4 | 47.2 | |
| Mistral medium 3.1Model Category=Closed-source Models, Thinking Mode=false2026.03 | 53.7 | 57.4 | 50 | 59.3 | 44.4 | 53.7 | 87 | 36.1 | |
| Doubao seed 1.6-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 53.7 | 45.4 | 57.9 | 69.4 | 50.9 | 60.2 | 88 | 36.1 | |
| ChatGPT o4 mini highModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 53.7 | 75 | 64.8 | 82.2 | 57.4 | 60.8 | 87.9 | 78 | |
| Claude Opus 4.1Model Category=Closed-source Models, Thinking Mode=false2026.03 | 52.8 | 56.5 | 75.7 | 76.8 | 70.4 | 63 | 83.3 | 35.2 | |
| Llama-4-Maverick-400BModel Category=Open-source Models, Thinking Mode=false2026.03 | 51.8 | 49.1 | 50.9 | 63 | 47.2 | 49.1 | 67.6 | 25.9 | |
| ChatGPT 4oModel Category=Closed-source Models, Thinking Mode=false2026.03 | 51.8 | 52.9 | 47.2 | 62 | 48.1 | 53.7 | 77.8 | 22.2 | |
| Claude Opus 4.1-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 51.8 | 59.3 | 63.6 | 81.5 | 75 | 63.6 | 79.6 | 43.5 | |
| Qwen2.5-VL-72B-InstructModel Category=Open-source Models, Thinking Mode=false2026.03 | 50.9 | 38 | 48.1 | 67.6 | 46.3 | 51.8 | 82.4 | 34.3 | |
| Doubao 1.5 vision proModel Category=Closed-source Models, Thinking Mode=false2026.03 | 50.9 | 63.9 | 49.5 | 73.2 | 60.2 | 61.1 | 80.6 | 4.6 | |
| ChatGPT 5Model Category=Closed-source Models, Thinking Mode=false2026.03 | 50.9 | 64.8 | 50 | 69.4 | 50 | 53.7 | 91.7 | 25 | |
| ChatGPT 5 highModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 50.9 | 62 | 50.9 | 69.4 | 50 | 57.6 | 91.5 | 28.8 | |
| Glm-4.5v-106BModel Category=Open-source Models, Thinking Mode=false2026.03 | 50 | 50.9 | 48.6 | 61.5 | 52.3 | 50.9 | 65 | 10.7 | |
| ChatGPT o3Model Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 50 | 75 | 57.4 | 75 | 55.6 | 61.7 | 88.8 | 44.9 | |
| Grok 4Model Category=Closed-source Models, Thinking Mode=false2026.03 | 49.1 | 61.1 | 60.2 | 72.2 | 42.6 | 52.8 | 76.8 | 45.4 | |
| Doubao seed 1.6 visionModel Category=Closed-source Models, Thinking Mode=false2026.03 | 48.1 | 52.8 | 46.7 | 54.6 | 47.2 | 47.2 | 70.4 | 41.7 | |
| Doubao 1.5 vision pro-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 47.2 | 48.2 | 46.7 | 67.6 | 44.4 | 47.2 | 83.3 | 10.2 | |
| Qwen3-VL-8B-InstructModel Category=Open-source Models, Thinking Mode=false2026.03 | 45.4 | 49.1 | 46.3 | 49.1 | 44.4 | 47.2 | 61.1 | 15.7 | |
| ChatGPT 4.1Model Category=Closed-source Models, Thinking Mode=false2026.03 | 34.3 | 29.6 | 33.3 | 62 | 41.7 | 48.1 | 69.4 | 27.8 |