Furniture assembly connection prediction on IKEA Furniture Assembly 102 items (test)
98.5F1 ScoreOracle
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| OracleContext=Ground truth connection information2026.03 | 98.5 | 100 | 97.6 | 94.1 | |
| Full ManualBackbone=GPT-4o, Context=Complete manual2026.03 | 53.7 | 62.4 | 50.1 | 8.8 | |
| RAG ImagesBackbone=GPT-4o, k=32026.03 | 51.3 | 60 | 47.3 | 8.8 | |
| Cover PageBackbone=GPT-4o, Context=Cover page diagram2026.03 | 46.7 | 55.4 | 42.4 | 6.9 | |
| Zero-ShotBackbone=GPT-4o2026.03 | 44.6 | 52.7 | 40.2 | 3.9 |