Assembly Graph Extraction (Set Matching) on Assembly Manual Dataset (85 steps) (test)
86.06F1 ScoreManual2Skill++
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Manual2Skill++Model backbone=Gemini-2.5-Pro, Manual completeness=Complete2025.10 | 86.06 | 69.41 | |
| Manual2Skill++Model backbone=Gemini-2.5-Pro, Manual completeness=Incomplete2025.10 | 82.68 | 63.53 | |
| Manual2Skill++Model backbone=GPT-4o, Manual completeness=Incomplete2025.10 | 75.82 | 41.18 | |
| Manual2Skill++Model backbone=GPT-4o, Manual completeness=Complete2025.10 | 74.55 | 45.88 | |
| Random SamplingStrategy=Random pair generation2025.10 | 53.51 | 9.41 | |
| Geometric MatchingDescription=OpenCV-based heuristic2025.10 | 0.02 | 0.02 |