skip to main content
research-article
Open Access

Synthesizing Indoor Scene Layouts in Complicated Architecture Using Dynamic Convolution Networks

Authors Info & Claims
Published:28 April 2021Publication History
Skip Abstract Section

Abstract

Synthesizing indoor scene layouts is challenging and critical, especially for digital design and gaming entertainment. Although there has been significant research on the indoor layout synthesis of rectangular-shaped or L-shaped architecture, there is little known about synthesizing plausible layouts for more complicated indoor architecture with both geometric and semantic information of indoor architecture being fully considered. In this paper, we propose an effective and novel framework to synthesize plausible indoor layouts in various and complicated architecture. The given indoor architecture is first encoded to our proposed representation, called InAiR, based on its geometric and semantic information. The indoor objects are grouped and then arranged by functional blocks, represented by oriented bounding boxes, using dynamic convolution networks based on their functionality and human activities. Through comparisons with other approaches as well as comparative user studies, we find that our generated indoor scene layouts for diverse, complicated indoor architecture are visually indistinguishable, which reach state-of-the-art performance.

References

  1. [n.d.]. EasyHome HomeStyler. https://www.homestyler.com/int/. Accessed 2019-8-11.Google ScholarGoogle Scholar
  2. [n.d.]. The IKEA Home Planner. https://www.ikea.com. Accessed 2019-8-11.Google ScholarGoogle Scholar
  3. [n.d.]. Planner5d. https://planner5d.com. Accessed 2019-8-11.Google ScholarGoogle Scholar
  4. Alexei Baevski and Michael Auli. 2018. Adaptive input representations for neural language modeling. arXiv preprint arXiv:1809.10853 (2018).Google ScholarGoogle Scholar
  5. Gino Bergen. 2003. Collision Detection in Interactive 3D Environments. https://doi.org/10.1201/9781482297997Google ScholarGoogle Scholar
  6. Yinpeng Chen, Xiyang Dai, Mengchen Liu, Dongdong Chen, Lu Yuan, and Zicheng Liu. 2020. Dynamic convolution: Attention over convolution kernels. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11030--11039.Google ScholarGoogle ScholarCross RefCross Ref
  7. Yubo Chen, Liheng Xu, Liu Kang, Daojian Zeng, and Jun Zhao. 2015. Event Extraction via Dynamic Multi-Pooling Convolutional Neural Networks. In Meeting of the Association for Computational Linguistics.Google ScholarGoogle ScholarCross RefCross Ref
  8. Angela Dai, Daniel Ritchie, Martin Bokeloh, Scott Reed, Jürgen Sturm, and Matthias Nießner. 2018. Scancomplete: Large-scale scene completion and semantic segmentation for 3d scans. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4578--4587.Google ScholarGoogle ScholarCross RefCross Ref
  9. Matthew Fisher, Manolis Savva, Yangyan Li, Pat Hanrahan, and Matthias Nießner. 2015. Activity-centric Scene Synthesis for Functional 3D Scene Modeling. ACM Transactions on Graphics (TOG) 34, 6 (2015), 179.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Qiang Fu, Xiaowu Chen, Xiaotian Wang, Sijia Wen, Bin Zhou, and Hongbo Fu. 2017. Adaptive synthesis of indoor scenes via activity-associated object relation graphs. ACM Transactions on Graphics (TOG) 36, 6 (2017), 201.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Paul Henderson, Kartic Subr, and Vittorio Ferrari. 2017. Automatic Generation of Constrained Furniture Layouts. arXiv preprint arXiv:1711.10939 (2017).Google ScholarGoogle Scholar
  12. Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In EMNLP.Google ScholarGoogle Scholar
  13. Yoon Kim, Yacine Jernite, David A Sontag, and Alexander M. Rush. 2016. Character-Aware Neural Language Models. In AAAI.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Kevin Lai, Liefeng Bo, and Dieter Fox. 2014. Unsupervised feature learning for 3d scene labeling. In 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 3050--3057.Google ScholarGoogle ScholarCross RefCross Ref
  15. Manyi Li, Akshay Gadi Patil, Kai Xu, Siddhartha Chaudhuri, Owais Khan, Ariel Shamir, Changhe Tu, Baoquan Chen, Daniel Cohen-Or, and Hao Zhang. 2019. GRAINS: Generative recursive autoencoders for indoor scenes. ACM Transactions on Graphics (TOG) 38, 2 (2019), 12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Paul Merrell, Eric Schkufza, Zeyang Li, Maneesh Agrawala, and Vladlen Koltun. 2011. Interactive furniture layout using interior design guidelines. In ACM transactions on graphics (TOG), Vol. 30. ACM, 87.Google ScholarGoogle Scholar
  17. Siyuan Qi, Yixin Zhu, Siyuan Huang, Chenfanfu Jiang, and Song Chun Zhu. 2018. Human-centric Indoor Scene Synthesis Using Stochastic Grammar. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5899--5908.Google ScholarGoogle ScholarCross RefCross Ref
  18. Daniel Ritchie, Kai Wang, and Yu-an Lin. 2019. Fast and flexible indoor scene synthesis via deep convolutional generative models. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 6182--6190.Google ScholarGoogle ScholarCross RefCross Ref
  19. Shuran Song, Fisher Yu, Andy Zeng, Angel X Chang, Manolis Savva, and Thomas Funkhouser. 2017. Semantic scene completion from a single depth image. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1746--1754.Google ScholarGoogle ScholarCross RefCross Ref
  20. Niko Sünderhauf, Trung T Pham, Yasir Latif, Michael Milford, and Ian Reid. 2017. Meaningful maps with object-oriented semantic mapping. In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 5079--5085.Google ScholarGoogle ScholarCross RefCross Ref
  21. Hajime Taira, Masatoshi Okutomi, Torsten Sattler, Mircea Cimpoi, Marc Pollefeys, Josef Sivic, Tomas Pajdla, and Akihiko Torii. 2018. InLoc: Indoor Visual Localization with Dense Matching and View Synthesis. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 7199--7209.Google ScholarGoogle ScholarCross RefCross Ref
  22. Kai Wang, Yu-An Lin, Ben Weissmann, Manolis Savva, Angel X Chang, and Daniel Ritchie. 2019. PlanIT: planning and instantiating indoor scenes with relation graph and spatial prior networks. ACM Transactions on Graphics (TOG) 38, 4 (2019), 132.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Kai Wang, Manolis Savva, Angel X Chang, and Daniel Ritchie. 2018. Deep convolutional priors for indoor scene synthesis. ACM Transactions on Graphics (TOG) 37, 4 (2018), 70.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Ken Xu, James Stewart, and Eugene Fiume. 2002. Constraint-based automatic placement for scene composition. In Graphics Interface, Vol. 2. 25--34.Google ScholarGoogle Scholar
  25. Lap-Fai Yu, Sai Kit Yeung, Chi-Keung Tang, Demetri Terzopoulos, Tony F Chan, and Stanley Osher. 2011. Make it home: automatic optimization of furniture arrangement. ACM Trans. Graph. 30, 4 (2011), 86.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Ye Zhang and Byron C. Wallace. 2015. A Sensitivity Analysis of (and Practitioners' Guide to) Convolutional Neural Networks for Sentence Classification. In IJCNLP.Google ScholarGoogle Scholar
  27. Zaiwei Zhang, Zhenpei Yang, Chongyang Ma, Linjie Luo, and Qixing Huang. 2018. Deep Generative Modeling for Scene Synthesis via Hybrid Representations. arXiv preprint arXiv:1808.02084 (2018).Google ScholarGoogle Scholar

Index Terms

  1. Synthesizing Indoor Scene Layouts in Complicated Architecture Using Dynamic Convolution Networks

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques
      Proceedings of the ACM on Computer Graphics and Interactive Techniques  Volume 4, Issue 1
      April 2021
      274 pages
      EISSN:2577-6193
      DOI:10.1145/3463840
      Issue’s Table of Contents

      Copyright © 2021 ACM

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 28 April 2021
      Published in pacmcgit Volume 4, Issue 1

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!