Concept-based classification on Gravity Spy
83.08Top-1 AccuracyLF-CBM
Evaluation results
| Method | Links | |
|---|---|---|
| LF-CBMLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 83.08 | |
| VLLM + S2COPE (Ours)Labels=Not Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 81 | |
| VLLM (Unoptimized)Labels=Not Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 60.83 | |
| LaBoLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 39.5 | |
| TextSpanLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 4.25 | |
| DCLIPLabels=Required, Architecture=Qwen3-VL-8B, Evaluation Protocol=Concept-based linear probing2026.06 | 2.17 |