Evaluation dataset
Benchmarks
TaskDatasetSOTA resultTrendResults
Evaluation Dataset
44.2xSVA
21
Evaluation dataset
51.98Accuracy
20
Evaluation Dataset (Unseen Average)
42.86Score
18
Evaluation Dataset Seen Average
62.34Score
18
Evaluation Dataset Unseen (Fold 3)
0.402Score
18
Evaluation Dataset (Fold 3 Seen)
66.69Score
18
Evaluation Dataset Unseen (Fold 2)
50Score
18
Evaluation Dataset (Fold 2 Seen)
63.63Score
18
Evaluation Dataset Unseen (Fold 1)
0.482Score
18
Evaluation Dataset (Fold 1 Seen)
0.619Score
18
Evaluation Dataset (Full)
0.638Score
18
Evaluation Dataset
99.5Accuracy
11
Evaluation Dataset 2000 samples
0.754Pearson Correlation Coefficient
7
Evaluation dataset unseen 3D assets (test)
0.272CLIP Similarity
6
Evaluation dataset unseen 3D assets (test)
0.292CLIP Similarity
6
858-image evaluation dataset identity-disjoint (test)
97.2Pair Accuracy
4
Evaluation Dataset
34.251FID
2
Evaluation dataset Full (4,556 skills)
487Total Flagged Count
1