# Text-to-Scene Generation on 3D-FRONT Livingroom (test) Source: [Text-to-Scene Generation on 3D-FRONT Livingroom (test)]() Collection index: [llms.txt]() Data updated: 2026-06-09T10:57:11.520Z Evaluation of Text-to-Scene generation models using the test split of the 3D-FRONT Livingroom subset, measured by generative quality metrics like FID, KID, SCA, and iRecall. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Text-to-scene generation | | Dataset (including any stated split) | 3D-FRONT Livingroom (test) | | Metric | FID | | Unit | SCALAR | | Direction | Lower is better | | Results loaded | 15 of 15 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [FID](): Lower is better; unit: SCALAR. - [FID (CLIP)](): Lower is better; unit: SCALAR. - [KID](): Lower is better; unit: SCALAR. - [SCA](): Higher is better; unit: PERCENT. - [iRecall](): Higher is better; unit: PERCENT. ## Recorded results | Method | FID | Result date | Report paper | | --- | --- | --- | --- | | AccioScene | 105.01 | Not recorded | 68fa76f21e209131cea7029e | | MG-DiT | 108.22 | Not recorded | 68fa791d1e209131cea7c2fb | | SceneNAT | 110.28 | Not recorded | 6965d1b26343fa78c832393a | | InstructScene | 110.39 | Not recorded | 68fa76f21e209131cea7029e | | MG-DiT | 110.55 | Not recorded | 68fa791d1e209131cea7c2fb | | FreeScene | 110.55 | Not recorded | 6965d1b26343fa78c832393a | | FreeScene | 110.55 | Not recorded | 68fa76f21e209131cea7029e | | InstructScene | 111.52 | Not recorded | 68fa791d1e209131cea7c2fb | | InstructScene | 111.52 | Not recorded | 6965d1b26343fa78c832393a | | ATISS | 117.67 | Not recorded | 68fa76f21e209131cea7029e | | ATISS | 120.1 | Not recorded | 68fa791d1e209131cea7c2fb | | ATISS | 120.1 | Not recorded | 6965d1b26343fa78c832393a | | DiffuScene | 122.2 | Not recorded | 68fa76f21e209131cea7029e | | DiffuScene | 135.93 | Not recorded | 68fa791d1e209131cea7c2fb | | DiffuScene | 135.93 | Not recorded | 6965d1b26343fa78c832393a | ### AccioScene FID: 105.01. Result ID: 6a27f182fbc373592c259832. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MG-DiT FID: 108.22. Result ID: 6995c6fd3badfaffe6ca89e1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Graph Designer":"enabled"}. This record does not assert independent reproduction. ### SceneNAT FID: 110.28. Result ID: 6997cbb25698665ec422daf9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Relational constraints":"Nrel \<= 2"}. This record does not assert independent reproduction. ### InstructScene FID: 110.39. Result ID: 6a27f182fbc373592c259830. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MG-DiT FID: 110.55. Result ID: 6995c6fd3badfaffe6ca89e0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Graph Designer":"disabled"}. This record does not assert independent reproduction. ### FreeScene FID: 110.55. Result ID: 6997cbb25698665ec422daf8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Relational constraints":"Nrel \<= 2"}. This record does not assert independent reproduction. ### FreeScene FID: 110.55. Result ID: 6a27f182fbc373592c259831. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"official results":"true"}. This record does not assert independent reproduction. ### InstructScene FID: 111.52. Result ID: 6995c6fd3badfaffe6ca89df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### InstructScene FID: 111.52. Result ID: 6997cbb25698665ec422daf7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Relational constraints":"Nrel \<= 2"}. This record does not assert independent reproduction. ### ATISS FID: 117.67. Result ID: 6a27f182fbc373592c25982e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ATISS FID: 120.1. Result ID: 6995c6fd3badfaffe6ca89dd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### ATISS FID: 120.1. Result ID: 6997cbb25698665ec422daf5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Relational constraints":"Nrel \<= 2"}. This record does not assert independent reproduction. ### DiffuScene FID: 122.2. Result ID: 6a27f182fbc373592c25982f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DiffuScene FID: 135.93. Result ID: 6995c6fd3badfaffe6ca89de. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### DiffuScene FID: 135.93. Result ID: 6997cbb25698665ec422daf6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Relational constraints":"Nrel \<= 2"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.