3D Object Classification on Objaverse-LVIS (test)
83.1Top-1 AccuracyUni3D
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Uni3Dshot=16-shot, protocol=linear probing2023.10 | 83.1 | — | — | |
| Uni3Dshot=8-shot, protocol=linear probing2023.10 | 73.6 | — | — | |
| Uni3Dshot=4-shot, protocol=linear probing2023.10 | 63.3 | — | — | |
| Uni3D †training shape source=Ensembled, best achieved=true2023.10 | 55.3 | 76.7 | 82.9 | |
| Uni3Dshot=2-shot, protocol=linear probing2023.10 | 54.1 | — | — | |
| Uni3Dtraining shape source=Ensembled2023.10 | 53.5 | 75.5 | 82 | |
| Uni3D-baseteacher=EVA-CLIP-18B, data=Ensembled, zero-shot=true2024.02 | 53.2 | — | — | |
| ViT-LENS_GPre-training=OpenShape-Triplets, Zero-shot=true2023.11 | 52 | 73.3 | 79.9 | |
| VIT-LENSGPre-training Dataset=OpenShape-Triplets [54], Backbone=ViT-bigG/142023.11 | 52 | 73.3 | 79.9 | |
| Uni3D-baseteacher=EVA-02-CLIP-E/14+, data=Ensembled, zero-shot=true2024.02 | 51.7 | — | — | |
| OpenShape-PointBERTshot=16-shot, protocol=linear probing2023.10 | 51.3 | — | — | |
| ViT-LENS_GPre-training=OpenShape-Triplets (No LVIS), Zero-shot=true2023.11 | 50.1 | 71.3 | 78.1 | |
| VIT-LENSGPre-training Dataset=OpenShape-Triplets (No LVIS) [54], Backbone=ViT-bigG/142023.11 | 50.1 | 71.3 | 78.1 | |
| TIGAUSSIANBase Model=Uni3D-S, Training Dataset=Objaverse-800k w/o LVIS, GS Points=10242026.01 | 50.1 | 73.6 | 79.6 | |
| ReCon++Base Model=ViT-B, Training Dataset=Ensembled w/o LVIS, GS Points=100002026.01 | 49.6 | 70.2 | 78.4 | |
| UniGSBase Model=Uni3D-S, Training Dataset=Objaverse-800k w/o LVIS, GS Points=10242026.01 | 48.8 | 69.1 | 76.9 | |
| MixCon3DBase Model=PointBERT, Training Dataset=Ensembled w/o LVIS, GS Points=100002026.01 | 47.5 | 69.6 | 76.2 | |
| Uni3Dtraining shape source=Ensembled (no LVIS)2023.10 | 47.2 | 68.8 | 76.1 | |
| OpenShape-SparseConvshot=16-shot, protocol=linear probing2023.10 | 47 | — | — | |
| Uni3D-baseteacher=EVA-CLIP-18B, data=w/o LVIS, zero-shot=true2024.02 | 47 | — | — | |
| OpenShape-PointBERTtraining shape source=Ensembled2023.10 | 46.8 | 69.1 | 77 | |
| OpenShape-PointBERTPre-training=OpenShape-Triplets, Zero-shot=true2023.11 | 46.8 | 69.1 | 77 | |
| OpenShape-PointBERTPre-training Dataset=OpenShape-Triplets [54]2023.11 | 46.8 | 69.1 | 77 | |
| Uni3Dshot=1-shot, protocol=linear probing2023.10 | 46.5 | — | — | |
| Uni3D-baseteacher=EVA-CLIP-8B, data=w/o LVIS, zero-shot=true2024.02 | 46.2 | — | — | |
| Uni3D-baseteacher=EVA-02-CLIP-E/14+, data=w/o LVIS, zero-shot=true2024.02 | 45.8 | — | — | |
| Uni3D-baseteacher=OpenCLIP-G/14, data=w/o LVIS, zero-shot=true2024.02 | 44.5 | — | — | |
| OpenShape-SparseConvtraining shape source=Ensembled2023.10 | 43.4 | 64.8 | 72.4 | |
| OpenShape-SparseConvPre-training=OpenShape-Triplets, Zero-shot=true2023.11 | 43.4 | 64.8 | 72.4 | |
| OpenShape-SparseConvPre-training Dataset=OpenShape-Triplets [54]2023.11 | 43.4 | 64.8 | 72.4 | |
| ULIP Retrainedshot=16-shot, protocol=linear probing2023.10 | 43 | — | — | |
| OpenShape-PointBERTshot=8-shot, protocol=linear probing2023.10 | 42.6 | — | — | |
| SUGAR (single)Pretrain data=Ensembled (no LVIS), Evaluation protocol=zero-shot2024.04 | 42.1 | 64.6 | 72.1 | |
| TAMMBase Model=PointBERT, Training Dataset=Ensembled w/o LVIS, GS Points=100002026.01 | 42 | 63.6 | 71.7 | |
| SUGAR (multi)Pretrain data=Ensembled (no LVIS), Evaluation protocol=zero-shot2024.04 | 39.4 | 61.6 | 69.3 | |
| OpenShape-PointBERTtraining shape source=Ensembled (no LVIS)2023.10 | 39.1 | 60.8 | 68.9 | |
| OpenShape-PointBERTPre-training=OpenShape-Triplets (No LVIS), Zero-shot=true2023.11 | 39.1 | 60.8 | 68.9 | |
| OpenShape-PointBERTPre-training Dataset=OpenShape-Triplets (No LVIS) [54]2023.11 | 39.1 | 60.8 | 68.9 | |
| OpenShapeBase Model=PointBERT, Training Dataset=Ensembled w/o LVIS, GS Points=100002026.01 | 39.1 | 60.8 | 68.9 | |
| OpenShape-PointBERTPretrain data=Ensembled (no LVIS), Evaluation protocol=zero-shot2024.04 | 39.1 | 60.8 | 68.9 | |
| OpenShape-SparseConvshot=8-shot, protocol=linear probing2023.10 | 37.8 | — | — | |
| OpenShape-SparseConvtraining shape source=Ensembled (no LVIS)2023.10 | 37 | 58.4 | 66.9 | |
| OpenShape-SparseConvPre-training=OpenShape-Triplets (No LVIS), Zero-shot=true2023.11 | 37 | 58.4 | 66.9 | |
| OpenShape-SparseConvPre-training Dataset=OpenShape-Triplets (No LVIS) [54]2023.11 | 37 | 58.4 | 66.9 | |
| OpenShape-PointBERTshot=4-shot, protocol=linear probing2023.10 | 36.4 | — | — | |
| ULIP Retrainedshot=8-shot, protocol=linear probing2023.10 | 34.9 | — | — | |
| ULIPshot=16-shot, protocol=linear probing2023.10 | 32.3 | — | — | |
| OpenShape-SparseConvshot=4-shot, protocol=linear probing2023.10 | 31.2 | — | — | |
| OpenShape-PointBERTshot=2-shot, protocol=linear probing2023.10 | 30.1 | — | — | |
| ULIP Retrainedshot=4-shot, protocol=linear probing2023.10 | 28.7 | — | — | |
| PointCLIP V2shot=16-shot, protocol=linear probing2023.10 | 27.9 | — | — | |
| ULIP-PointBERTtraining shape source=Ensembled2023.10 | 26.8 | 44.8 | 52.6 | |
| ULIP-PointBERTPre-training=OpenShape-Triplets, Zero-shot=true2023.11 | 26.8 | 44.8 | 52.6 | |
| ULIP-PointBERTPre-training Dataset=OpenShape-Triplets [54]2023.11 | 26.8 | 44.8 | 52.6 | |
| OpenShape-SparseConvshot=2-shot, protocol=linear probing2023.10 | 25.8 | — | — | |
| ULIPshot=8-shot, protocol=linear probing2023.10 | 25.3 | — | — | |
| OpenShape-PointBERTshot=1-shot, protocol=linear probing2023.10 | 24 | — | — | |
| ULIP Retrainedshot=2-shot, protocol=linear probing2023.10 | 23.8 | — | — | |
| ULIP-PointBERTtraining shape source=Ensembled (no LVIS)2023.10 | 21.4 | 38.1 | 46 | |
| ULIP-PointBERTPre-training=OpenShape-Triplets (No LVIS), Zero-shot=true2023.11 | 21.4 | 38.1 | 46 | |
| ULIP-PointBERTPre-training Dataset=OpenShape-Triplets (No LVIS) [54]2023.11 | 21.4 | 38.1 | 46 | |
| ULIP-PointBERTPretrain data=Ensembled (no LVIS), Evaluation protocol=zero-shot2024.04 | 21.4 | 38.1 | 46 | |
| OpenShape-SparseConvshot=1-shot, protocol=linear probing2023.10 | 21.2 | — | — | |
| PointCLIP V2shot=8-shot, protocol=linear probing2023.10 | 21 | — | — | |
| ULIPshot=4-shot, protocol=linear probing2023.10 | 20.3 | — | — | |
| ULIP Retrainedshot=1-shot, protocol=linear probing2023.10 | 18.9 | — | — | |
| ULIPshot=2-shot, protocol=linear probing2023.10 | 16.3 | — | — | |
| PointCLIP V2shot=4-shot, protocol=linear probing2023.10 | 16.1 | — | — | |
| ULIPshot=1-shot, protocol=linear probing2023.10 | 13.3 | — | — | |
| SUGAR (single)Pretrain data=ShapeNet, Evaluation protocol=zero-shot2024.04 | 13.3 | 22.6 | 27.3 | |
| PointCLIP V2shot=2-shot, protocol=linear probing2023.10 | 12.3 | — | — | |
| SUGAR (multi)Pretrain data=ShapeNet, Evaluation protocol=zero-shot2024.04 | 12.1 | 20.1 | 25.1 | |
| OpenShape-PointBERTPretrain data=ShapeNet, Evaluation protocol=zero-shot2024.04 | 10.8 | 20.2 | 25 | |
| PointCLIP V2shot=1-shot, protocol=linear probing2023.10 | 9.6 | — | — | |
| ULIP-PointBERTPretrain data=ShapeNet, Evaluation protocol=zero-shot2024.04 | 6.2 | 13.6 | 17.9 | |
| PointCLIP v2Pre-training=2D inference, no 3D training, Zero-shot=true2023.11 | 4.7 | 9.5 | 12.9 | |
| PointCLIP v2Note=2D inference, no 3D training2023.11 | 4.7 | 9.5 | 12.9 | |
| CLIP2PointPretrain data=ShapeNet, Evaluation protocol=zero-shot2024.04 | 2.7 | 5.8 | 7.9 | |
| PointCLIPPre-training=2D inference, no 3D training, Zero-shot=true2023.11 | 1.9 | 4.1 | 5.8 | |
| PointCLIPNote=2D inference, no 3D training2023.11 | 1.9 | 4.1 | 5.8 | |
| ReConPretrain data=ShapeNet, Evaluation protocol=zero-shot2024.04 | 1.1 | 2.7 | 3.7 | |
| OpenShape-PointBERTtraining shape=Ensembled, zero-shot=true2023.05 | 0.468 | 0.691 | 0.77 | |
| OpenShape-SparseConvtraining shape=Ensembled, zero-shot=true2023.05 | 0.434 | 0.648 | 0.724 | |
| OpenShape-PointBERTtraining shape=Ensembled (no LVIS), zero-shot=true2023.05 | 0.391 | 0.608 | 0.689 | |
| OpenShape-SparseConvtraining shape=Ensembled (no LVIS), zero-shot=true2023.05 | 0.37 | 0.584 | 0.669 | |
| ULIP-PointBERT (Retrained)training shape=Ensembled, zero-shot=true2023.05 | 0.268 | 0.448 | 0.526 | |
| ULIP-PointBERT (Retrained)training shape=Ensembled (no LVIS), zero-shot=true2023.05 | 0.214 | 0.381 | 0.46 | |
| OpenShape-SparseConvtraining shape=ShapeNet, zero-shot=true2023.05 | 0.116 | 0.218 | 0.271 | |
| OpenShape-PointBERTtraining shape=ShapeNet, zero-shot=true2023.05 | 0.108 | 0.202 | 0.25 | |
| ULIP-PointBERT (Official)training shape=ShapeNet, zero-shot=true2023.05 | 0.062 | 0.136 | 0.179 | |
| CG3Dtraining shape=ShapeNet, zero-shot=true2023.05 | 0.05 | 0.095 | 0.116 | |
| PointCLIP v2training shape=2D inferences, no 3D Training, zero-shot=true2023.05 | 0.047 | 0.095 | 0.129 | |
| CLIP2Pointtraining shape=ShapeNet, zero-shot=true2023.05 | 0.027 | 0.058 | 0.079 | |
| PointCLIPtraining shape=2D inferences, no 3D Training, zero-shot=true2023.05 | 0.019 | 0.041 | 0.058 | |
| ReContraining shape=ShapeNet, zero-shot=true2023.05 | 0.011 | 0.022 | 0.037 |