Concept-based Classification on HAM10000
79.27Top-1 AccuracyVLLM + S2COPE (Ours)
Evaluation results
| Method | Links | |
|---|---|---|
| VLLM + S2COPE (Ours)Labels=Not Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 79.27 | |
| LF-CBMLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 70.98 | |
| VLLM (Unoptimized)Labels=Not Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 65.28 | |
| LaBoLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 63.73 | |
| DCLIPLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 33.16 | |
| TextSpanLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 17.1 |