Optimal Asset Selection on METASCENES 1.0 (test)
28.4Top-1 AccSCAN2SIM
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SCAN2SIMModality: Input=I+T, Modality: Cand.=P2025.05 | 28.4 | 76 | 0.17 | 0.23 | 0.6 | 24.65 | |
| GPT-4VModality: Input=T, Modality: Cand.=I2025.05 | 16.5 | 59.9 | 0.19 | 0.26 | 0.52 | 32.66 | |
| CLIPModality: Input=T, Modality: Cand.=I2025.05 | 14.9 | 66.6 | 0.21 | 0.27 | 0.51 | 28.02 | |
| ULIP-2Modality: Input=T, Modality: Cand.=P2025.05 | 14.3 | 60.3 | 0.19 | 0.25 | 0.52 | 32.34 | |
| ULIP-2Modality: Input=I+T, Modality: Cand.=P2025.05 | 13.1 | 57.7 | 0.2 | 0.26 | 0.49 | 37.49 | |
| ACDCModality: Input=I+T, Modality: Cand.=I2025.05 | 12.3 | 36.6 | 0.21 | 0.27 | 0.47 | 37.92 | |
| ULIP-2Modality: Input=I, Modality: Cand.=P2025.05 | 12 | 59.8 | 0.22 | 0.28 | 0.44 | 42.36 | |
| PointNet++Modality: Input=P, Modality: Cand.=P2025.05 | 11.8 | 52.5 | 0.22 | 0.28 | 0.49 | 37.5 | |
| Uni3DModality: Input=I, Modality: Cand.=P2025.05 | 11.1 | 51.8 | 0.23 | 0.29 | 0.45 | 39.22 | |
| Uni3DModality: Input=T, Modality: Cand.=P2025.05 | 10.2 | 51.9 | 0.26 | 0.32 | 0.43 | 37.14 | |
| Point-BERTModality: Input=P, Modality: Cand.=P2025.05 | 9.5 | 51.6 | 0.22 | 0.28 | 0.47 | 43.48 | |
| ICPModality: Input=P, Modality: Cand.=P2025.05 | 9.2 | 52.5 | 0.24 | 0.3 | 0.4 | 41.34 | |
| SSIMModality: Input=I, Modality: Cand.=I2025.05 | 6.3 | 44.4 | 0.24 | 0.31 | 0.4 | 48.1 | |
| LPIPSModality: Input=I, Modality: Cand.=I2025.05 | 5.9 | 45.5 | 0.24 | 0.3 | 0.4 | 48.01 |