Concept-based classification on OrganCMNIST
89.17Top-1 AccuracyVLLM + S2COPE (Ours)
Evaluation results
| Method | Links | |
|---|---|---|
| VLLM + S2COPE (Ours)Labels=Not Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 89.17 | |
| LF-CBMLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 78.85 | |
| VLLM (Unoptimized)Labels=Not Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 68.06 | |
| LaBoLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 54.1 | |
| DCLIPLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 10.41 | |
| TextSpanLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 7.4 |