3D Dense Captioning on ScanRefer
78.8CIDEr@0.5IoU3D-LLaVA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| 3D-LLaVASegmenter=✓, #Params=58.26M, FLOP=37.752026.02 | 78.8 | 36.9 | 27.1 | 57.7 | — | |
| Fase3DSegmenter=✓, #Params=10.54M, FLOP=2.042026.02 | 78.14 | 41.34 | 27.92 | 57.63 | — | |
| Fase3DSegmenter=✗, #Params=10.54M, FLOP=2.042026.02 | 70.72 | 37.83 | 26.81 | 56.37 | — | |
| PerLASegmenter=✓, #Params=119.76M, FLOP=326.762026.02 | 69.41 | 38.02 | 29.07 | 56.8 | — | |
| LL3DASegmenter=✓, #Params=118.87M, FLOP=80.432026.02 | 65.19 | 36.79 | 25.97 | 55.06 | — | |
| OursData=2D+3D, Detector=VoteNet, CIDEr score reward=true2022.10 | 54.3 | 27.24 | 23.3 | 45.81 | 42.77 | |
| OursData=3D, Detector=VoteNet, CIDEr score reward=true2022.10 | 50.29 | 25.64 | 22.57 | 44.71 | 35.97 | |
| 3DJCGData=2D+3D, Detector=VoteNet2022.10 | 49.48 | 31.03 | 24.22 | 50.8 | — | |
| 3DJCGData=3D, Detector=VoteNet2022.10 | 47.68 | 31.53 | 24.28 | 51.08 | — | |
| D3NetData=2D+3D, Detector=VoteNet, CIDEr score reward=true2022.10 | 47.32 | 24.76 | 21.66 | 43.62 | 38.03 | |
| OursData=2D+3D, Detector=VoteNet, CIDEr score reward=false2022.10 | 46.11 | 25.47 | 22.64 | 45.96 | 42.91 | |
| SpaCap3DData=2D+3D, Detector=VoteNet2022.10 | 44.02 | 25.26 | 22.33 | 45.36 | 36.64 | |
| X-Trans2CapData=2D+3D, Detector=VoteNet2022.10 | 43.87 | 25.05 | 22.46 | 45.28 | 35.31 | |
| OursData=3D, Detector=VoteNet, CIDEr score reward=false2022.10 | 42.77 | 23.6 | 22.05 | 45.13 | 36.99 | |
| SpaCap3DData=3D, Detector=VoteNet2022.10 | 42.53 | 25.02 | 22.22 | 45.65 | 34.44 | |
| X-Trans2CapData=3D, Detector=VoteNet2022.10 | 41.52 | 23.83 | 21.9 | 44.97 | 34.68 | |
| MOREData=2D+3D, Detector=VoteNet2022.10 | 40.94 | 22.93 | 21.66 | 44.42 | 33.75 | |
| Scan2CapData=2D+3D, Detector=VoteNet2022.10 | 39.08 | 23.32 | 21.97 | 44.78 | 32.21 | |
| D3NetData=2D+3D, Detector=VoteNet2022.10 | 39.08 | 23.32 | 21.97 | 44.78 | 36.13 | |
| MOREData=3D, Detector=VoteNet2022.10 | 38.98 | 23.01 | 21.65 | 44.33 | 31.93 | |
| Scan2CapData=3D, Detector=VoteNet2022.10 | 32.94 | 20.63 | 21.1 | 41.58 | 27.45 |