Concept-based classification on iNaturalist (Top-1 Accuracy)
85Top-1 AccuracyVLLM + S2COPE (Ours)
Evaluation results
| Method | Links | |
|---|---|---|
| VLLM + S2COPE (Ours)Labels=Not Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 85 | |
| LF-CBMLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 73.85 | |
| VLLM (Unoptimized)Labels=Not Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 71.15 | |
| LaBoLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 42.69 | |
| DCLIPLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 23.46 | |
| TextSpanLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 20 |