ScanRefer
Benchmarks
TaskDatasetSOTA resultTrendResults
ScanRefer (val)
66.83Overall Accuracy @ IoU 0.50
262
ScanRefer
66Acc@0.25
172
ScanRefer v1 (test)
58.89Acc@0.25IoU
96
ScanRefer (val)
106.11CIDEr
91
ScanRefer Overall
61.6Acc @ 0.5
55
ScanRefer (val)
74.6mIoU
43
ScanRefer Unique
90.3Acc@0.25 (IoU=0.25)
41
ScanRefer
89.57CIDEr (IoU=0.50)
36
ScanRefer v1 (val)
84Acc@0.5 (Unique)
35
ScanRefer (test)
86.28CIDEr
30
ScanRefer Multiple
52.5Accuracy @ IoU=0.50
29
ScanRefer (test)
59.98Accuracy@0.25
29
ScanRefer
62Accuracy @ 0.25
25
ScanRefer
58.47Overall@0.25 Accuracy
21
ScanRefer
78.8CIDEr@0.5IoU
21
ScanRefer 10 (val)
62.9Accuracy @ IoU=0.25 (Overall)
16
ScanRefer Multiple (val)
52Accuracy @ IoU 0.25
15
ScanRefer
84.1Caption Score (0.5 IoU)
13
ScanRefer Overall category (test)
61.1Accuracy
13
ScanRefer
62.6Accuracy @ 0.25 IoU
11
ScanRefer detected proposals v1 (val)
88.63Unique Acc@0.25
10
ScanRefer (test)
53.95mAP@0.5
10
ScanRefer 2020 (test)
88.7Unique Metric Score
9
ScanRefer Overall 1 (val)
57.9Acc@0.25
9
ScanRefer
44.8mIoU
9