Natural Language Camera Agent on SCOPE
56.5Comparative RelationalQwen3-30B-A3B (Moondream3)
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-30B-A3B (Moondream3)VLM Family=Moondream3, SLM Planner=Qwen3-30B-A3B, Parameter Scale=30B-A3B, Precision=FP162026.06 | 56.5 | 76.8 | 37.1 | 66 | 98.2 | 79.6 | 77.8 | 98.6 | 73.8 | |
| Qwen3-30B-A3B-FP8 (Moondream2)VLM Family=Moondream2, SLM Planner=Qwen3-30B-A3B, Parameter Scale=30B-A3B, Precision=FP82026.06 | 50 | 72.6 | 50.6 | 56.6 | 89.5 | 79.6 | 59.3 | 98.6 | 69.6 | |
| Qwen3-30B-A3B-FP8 (Moondream2-4bit)VLM Family=Moondream2, VLM Quantization=4-bit, SLM Planner=Qwen3-30B-A3B, Parameter Scale=30B-A3B, Precision=FP82026.06 | 50 | 65.3 | 55.1 | 50.9 | 93 | 72.2 | 40.7 | 98.6 | 65.7 | |
| Qwen3-30B-A3B-FP8 (Moondream3)VLM Family=Moondream3, SLM Planner=Qwen3-30B-A3B, Parameter Scale=30B-A3B, Precision=FP82026.06 | 48.4 | 74.7 | 38.2 | 52.8 | 86 | 75.9 | 77.8 | 98.6 | 69.1 | |
| Qwen3-Next-80B-A3B (Moondream2)VLM Family=Moondream2, SLM Planner=Qwen3-Next-80B-A3B, Parameter Scale=80B-A3B, Precision=FP162026.06 | 46.8 | 76.8 | 48.3 | 58.5 | 96.5 | 83.3 | 55.6 | 98.6 | 70.6 | |
| Qwen3-32B (Moondream3)VLM Family=Moondream3, SLM Planner=Qwen3-32B, Parameter Scale=32B, Precision=FP162026.06 | 45.2 | 68.4 | 39.3 | 52.8 | 89.5 | 72.2 | 83.3 | 100 | 68.8 | |
| Qwen3-Next-80B-A3B (Moondream3)VLM Family=Moondream3, SLM Planner=Qwen3-Next-80B-A3B, Parameter Scale=80B-A3B, Precision=FP162026.06 | 45.2 | 72.6 | 34.8 | 47.2 | 98.2 | 74.1 | 83.3 | 98.6 | 69.3 | |
| Qwen3-30B-A3B (Moondream2)VLM Family=Moondream2, SLM Planner=Qwen3-30B-A3B, Parameter Scale=30B-A3B, Precision=FP162026.06 | 43.5 | 70.5 | 44.9 | 52.8 | 93 | 81.5 | 53.7 | 98.6 | 67.3 | |
| Qwen3-32B (Moondream2)VLM Family=Moondream2, SLM Planner=Qwen3-32B, Parameter Scale=32B, Precision=FP162026.06 | 41.9 | 70.5 | 46.1 | 64.2 | 96.5 | 72.2 | 53.7 | 98.6 | 68 | |
| Qwen3-30B-A3B (Moondream2-4bit)VLM Family=Moondream2, VLM Quantization=4-bit, SLM Planner=Qwen3-30B-A3B, Parameter Scale=30B-A3B, Precision=FP162026.06 | 41.9 | 64.2 | 49.4 | 58.5 | 98.2 | 72.2 | 51.9 | 98.6 | 66.9 | |
| Qwen3-32B (Moondream2-4bit)VLM Family=Moondream2, VLM Quantization=4-bit, SLM Planner=Qwen3-32B, Parameter Scale=32B, Precision=FP162026.06 | 37.1 | 60 | 59.6 | 64.2 | 87.7 | 68.5 | 51.9 | 98.6 | 65.9 | |
| Qwen3-Next-80B-A3B (Moondream2-4bit)VLM Family=Moondream2, VLM Quantization=4-bit, SLM Planner=Qwen3-Next-80B-A3B, Parameter Scale=80B-A3B, Precision=FP162026.06 | 36.5 | 65.3 | 52.8 | 58.5 | 98.2 | 75.9 | 48.1 | 98.6 | 66.8 | |
| Qwen3-Next-80B-A3B (Qwen2.5-VL-7B)VLM Family=Qwen2.5-VL-7B, SLM Planner=Qwen3-Next-80B-A3B, Parameter Scale=80B-A3B, Precision=FP162026.06 | 33.9 | 52.6 | 52.8 | 66 | 93 | 72.2 | 75.9 | 100 | 68.3 | |
| Qwen3-4B (Moondream2-4bit)VLM Family=Moondream2, VLM Quantization=4-bit, SLM Planner=Qwen3-4B, Parameter Scale=4B, Precision=FP162026.06 | 32.3 | 62.1 | 47.2 | 50.9 | 91.2 | 66.7 | 48.1 | 100 | 62.3 | |
| Qwen3-4B (Moondream3)VLM Family=Moondream3, SLM Planner=Qwen3-4B, Parameter Scale=4B, Precision=FP162026.06 | 32.3 | 68.4 | 33.7 | 47.2 | 87.7 | 55.6 | 66.7 | 100 | 61.4 | |
| Qwen3-4B-FP8 (Moondream3)VLM Family=Moondream3, SLM Planner=Qwen3-4B, Parameter Scale=4B, Precision=FP82026.06 | 30.6 | 73.7 | 34.8 | 58.5 | 87.7 | 59.3 | 57.4 | 98.6 | 62.6 | |
| Qwen3-4B (Moondream2)VLM Family=Moondream2, SLM Planner=Qwen3-4B, Parameter Scale=4B, Precision=FP162026.06 | 27.4 | 68.4 | 38.2 | 52.8 | 89.5 | 64.8 | 38.9 | 97.2 | 59.7 | |
| Qwen3-4B-FP8 (Moondream2)VLM Family=Moondream2, SLM Planner=Qwen3-4B, Parameter Scale=4B, Precision=FP82026.06 | 27.4 | 69.5 | 40.4 | 56.6 | 89.5 | 61.1 | 40.7 | 97.2 | 60.3 | |
| Qwen3-4B-FP8 (Moondream2-4bit)VLM Family=Moondream2, VLM Quantization=4-bit, SLM Planner=Qwen3-4B, Parameter Scale=4B, Precision=FP82026.06 | 27.4 | 62.1 | 48.3 | 52.8 | 89.5 | 66.7 | 46.3 | 97.2 | 61.3 |