Astronomical Spectrum Classification on SDSS (unseen)
84.9CVSpec-o3-7B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Spec-o3-7BParameters=7B2026.01 | 84.9 | 79.8 | 78.5 | 81.1 | |
| Spec-o3-3BParameters=3B2026.01 | 79.3 | 76.4 | 76.3 | 77.3 | |
| o3Model Type=Proprietary VLM2026.01 | 59.8 | 54.3 | 57.1 | 57.1 | |
| GaiaNetModel Type=Specialist Deep Learning Model2026.01 | 58.5 | 67.1 | 41.3 | 55.6 | |
| AstroCLIPModel Type=Specialist Deep Learning Model2026.01 | 53.9 | 64.1 | 46.4 | 54.8 | |
| CarbonNetModel Type=Specialist Deep Learning Model2026.01 | 49.8 | 66.5 | 46.9 | 54.4 | |
| Qwen3-VL-30B-A3BModel Type=Open-source VLM, Parameters=30B2026.01 | 32.1 | 34.4 | 29.8 | 32.1 | |
| Qwen3-VL-8BModel Type=Open-source VLM, Parameters=8B2026.01 | 30.9 | 26.9 | 29.8 | 29.2 | |
| GPT-4.1Model Type=Proprietary VLM2026.01 | 29.4 | 33.4 | 28.8 | 30.5 | |
| Qwen2.5-VL-7BModel Type=Open-source VLM, Parameters=7B2026.01 | 26.7 | 25.9 | 27.2 | 26.6 | |
| Qwen2.5-VL-3BModel Type=Open-source VLM, Parameters=3B2026.01 | 22.6 | 25.3 | 25.4 | 24.4 |