Material classification on 3D physical scene properties (test)
83.6ROC AUCStable Diffusion
Evaluation Results
| Method | Links | |
|---|---|---|
| Stable DiffusionEvaluation protocol=SVM grid search (best time step, layer and C)2023.10 | 83.6 | |
| DINOv2Backbone=ViT-G, Pre-training dataset=LVD-142M, Evaluation protocol=SVM grid search (best layer and C)2023.10 | 83.5 | |
| DINOv1Backbone=ViT-B, Pre-training dataset=ImageNet, Evaluation protocol=SVM grid search (best layer and C)2023.10 | 78.8 | |
| OpenCLIPBackbone=ViT-G, Pre-training dataset=LAION, Evaluation protocol=SVM grid search (best layer and C)2023.10 | 78.7 | |
| VQGANBackbone=48-layer transformer, Pre-training dataset=ImageNet, Evaluation protocol=SVM grid search (best layer and C)2023.10 | 65.5 | |
| RandomDescription=Random classifier2023.10 | 50 |