SQA3D
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SQA3D (test)
64.8EM@1
197
SQA3D
61.3EM
69
SQA3D (test)
54.57Average Accuracy
40
SQA3D
60.6Exact Match (EM)
34
SQA3D
58.6EM@1
30
SQA3D (test)
62.1EM (What)
23
SQA3D (test)
50.3Overall Accuracy
22
SQA3D
58.6EM
20
SQA3D
62.3EM
18
SQA3D (val)
60.8EM
17
SQA3D
62.6Score
14
SQA3D
60.7EM-1
14
SQA3D ScanNet scenes (test)
54.9BLEU-1
13
SQA3D (test)
63EM@1
12
SQA3D (test)
41Accuracy
9
SQA3D
47.7What Accuracy
9
SQA3D
0.603Exact Match (EM)
8
SQA3D (test)
42.6Accuracy @ 0.5m
8
SQA3D v1.0 (test)
59EM@1
8
SQA3D (test)
20.7Accuracy @ 0.5m
6
SQA3D 1.0 (test)
28.7Acc @ 15°
5
SQA3D 1.0 (test)
0.274Accuracy @ 0.5m
5
SQA3D
51.6F1@50
3
SQA3D
39.7EM-R
3
SQA3D-G
51.6F1@50
2