skip to main content
research-article

EasyVRModeling: Easily Create 3D Models by an Immersive VR System

Published:04 May 2022Publication History
Skip Abstract Section

Abstract

The latest innovations of VR make it possible to construct 3D models in a holographic immersive simulation environment. In this paper, we develop a user-friendly mid-air interactive modeling system named EasyVRModeling. We first prepare a dataset consisting of diverse components and precompute the discrete signed distance function (SDF) for each component. During the modeling phase, users can freely design complicated shapes with a pair of VR controllers. Based on the discrete SDF representation, any CSG-like operation (union, intersect, subtract) can be performed voxel-wise. Throughout the modeling process, we maintain one single dynamic SDF for the whole scene so that the zero-level set surface of the SDF exactly encodes the up-to-date constructed shape. Both SDF fusion and surface extraction are implemented via GPU to allow for smooth user experience. We asked 34 volunteers to create their favorite models using EasyVRModeling. With a simple training process for several minutes, most of them can create a fascinating shape or even a descriptive scene very quickly.

Skip Supplemental Material Section

Supplemental Material

References

  1. Duncan Fraser Armin Rigo, Maciej Fijałkowski. 2020. version 16.0.0. Baroque Software. https://vrsketch.eu/Google ScholarGoogle Scholar
  2. Rahul Arora. 2020. Creative Expression with Immersive 3D Interactions. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3334480.3375028Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Rahul Arora and Karan Singh. 2021. Mid-Air Drawing of Curves on 3D Surfaces in Virtual Reality. ACM Transactions on Graphics (TOG) (2021).Google ScholarGoogle Scholar
  4. Andreas Bærentzen, Jeppe Revall Frisvad, and Karan Singh. 2019. Signifier-Based Immersive and Interactive 3D Modeling. In 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST '19). Association for Computing Machinery, New York, NY, USA, Article 18, 5 pages. https://doi.org/10.1145/3359996.3364257Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Lee Beever, Serban Pop, and Nigel W. John. 2020. LevelEd VR: A virtual reality level editor and workflow for virtual reality level design. In 2020 IEEE Conference on Games (CoG). 136--143. https://doi.org/10.1109/CoG47356.2020.9231769Google ScholarGoogle ScholarCross RefCross Ref
  6. Erin Cherry and Celine Latulipe. 2014. Quantifying the creativity support of digital tools through the creativity support index. ACM Transactions on Computer-Human Interaction (TOCHI) 21, 4 (2014), 1--25.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Bruno Rodrigues De Araújo, Daniel S Lopes, Pauline Jepp, Joaquim A Jorge, and Brian Wyvill. 2015. A survey on implicit surface polygonization. ACM Computing Surveys (CSUR) 47, 4 (2015), 1--39.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Josen Daniel O. De Leon, Romelio P. Tavas, Rodolfo A. Aranzanso, and Rowel O. Atienza. 2016. Genesys: A Virtual Reality scene builder. In 2016 IEEE Region 10 Conference (TENCON). 3708--3711. https://doi.org/10.1109/TENCON.2016.7848751Google ScholarGoogle ScholarCross RefCross Ref
  9. Tobias Drey, Jan Gugenheimer, Julian Karlbauer, Maximilian Milo, and Enrico Rukzio. 2020. VRSketchIn: Exploring the Design Space of Pen and Tablet Interaction for 3D Sketching in Virtual Reality. Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376628Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Zhongxiang Duan, Qin Yang, Xianhai Meng, and Jigang Li. 2020. Detailed Voxel-Based Implicit Modeling With Local Boolean Composition of Discrete Level Sets. IEEE Access 8 (2020), 48376--48385. https://doi.org/10.1109/ACCESS.2020.2979571Google ScholarGoogle Scholar
  11. Alex Evans. 2015. Learning from failure: a survey of promising, unconventional and mostly abandoned renderers for 'dreams ps4', a geometrically dense, painterly ugc game. Advances in Real-Time Rendering in Games. MediaMolecule, SIGGRAPH (2015).Google ScholarGoogle Scholar
  12. Stanley Osher Ronald Fedkiw and Stanley Osher. 2002. Level set methods and dynamic implicit surfaces. Surfaces 44, 77 (2002), 685.Google ScholarGoogle Scholar
  13. João Ferreira, Daniel Mendes, Rui Nóbrega, and Rui Rodrigues. 2021. Immersive Multimodal and Procedurally-Assisted Creation of VR Environments. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 30--37. https://doi.org/10.1109/VRW52623.2021.00012Google ScholarGoogle Scholar
  14. Stefan Gottschalk, Ming C Lin, and Dinesh Manocha. 1996. OBBTree: A hierarchical structure for rapid interference detection. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. 171--180.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 2006. Teddy: a sketching interface for 3D freeform design. In ACM SIGGRAPH 2006 Courses. 11-es.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Bret Jackson and Daniel F. Keefe. 2016. Lift-Off: Using Reference Imagery and Freehand Sketching to Create 3D Models in VR. IEEE Transactions on Visualization and Computer Graphics 22, 4 (2016), 1442--1451. https://doi.org/10.1109/TVCG.2016.2518099Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Jason Jerald and Richard Marks. 2016. Human-Centered Design for VR Interactions. In ACM SIGGRAPH 2016 Courses (Anaheim, California) (SIGGRAPH '16). Association for Computing Machinery, New York, NY, USA, Article 15, 60 pages. https://doi.org/10.1145/2897826.2927320Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Jason Jerald, Paul Mlyniec, Arun Yoganandan, Amir Rubin, Dan Paullus, and Simon Solotko. 2013. Makevr: A 3d world-building interface. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 197--198.Google ScholarGoogle ScholarCross RefCross Ref
  19. Leif P Kobbelt, Mario Botsch, Ulrich Schwanecke, and Hans-Peter Seidel. 2001. Feature sensitive surface extraction from volume data. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 57--66.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Eric Larsen, Stefan Gottschalk, Ming C Lin, and Dinesh Manocha. 1999. Fast proximity queries with swept sphere volumes. Technical Report.Google ScholarGoogle Scholar
  21. Thomas Lewiner, Hélio Lopes, Antônio Wilson Vieira, and Geovan Tavares. 2003. Efficient implementation of marching cubes' cases with topological guarantees. Journal of graphics tools 8, 2 (2003), 1--15.Google ScholarGoogle ScholarCross RefCross Ref
  22. Yong-Jin Liu, Cui-Xia Ma, and Dong-Liang Zhang. 2011. EasyToy: Plush Toy Design Using Editable Sketching Curves. IEEE Computer Graphics and Applications 31, 2 (2011), 49--57. https://doi.org/10.1109/MCG.2009.147Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Pedro Lopes, Daniel Mendes, Bruno Araújo, and Joaquim A Jorge. 2011. Combining bimanual manipulation and pen-based input for 3d modelling. In Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling. 15--22.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. William E Lorensen and Harvey E Cline. 1987. Marching cubes: A high resolution 3D surface construction algorithm. ACM siggraph computer graphics 21, 4 (1987), 163--169.Google ScholarGoogle Scholar
  25. Tim McInemey and Demetri Terzopoulos. 1999. Topology adaptive deformable surfaces for medical image volume segmentation. IEEE transactions on medical imaging 18, 10 (1999), 840--850.Google ScholarGoogle Scholar
  26. Daniel Mendes, Daniel Medeiros, Maurício Sousa, Ricardo Ferreira, Alberto Raposo, Alfredo Ferreira, and Joaquim Jorge. 2017. Mid-air modeling with Boolean operations in VR. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). 154--157. https://doi.org/10.1109/3DUI.2017.7893332Google ScholarGoogle ScholarCross RefCross Ref
  27. Timothy S Newman and Hong Yi. 2006. A survey of the marching cubes algorithm. Computers & Graphics 30, 5 (2006), 854--879.Google ScholarGoogle ScholarCross RefCross Ref
  28. Stanley Osher and Ronald Fedkiw. 2006. Level set methods and dynamic implicit surfaces. Vol. 153. Springer Science & Business Media.Google ScholarGoogle Scholar
  29. Alexander Pasko, Valery Adzhiev, Alexei Sourin, and Vladimir Savchenko. 1995. Function representation in geometric modeling: concepts, implementation and applications. The visual computer 11, 8 (1995), 429--446.Google ScholarGoogle Scholar
  30. Mengqi Peng, Jun Xing, and Li Yi Wei. 2018. Autocomplete 3D sculpting. ACM Transactions on Graphics (TOG) (2018).Google ScholarGoogle Scholar
  31. Ryan Schmidt, Brian Wyvill, Mario Costa Sousa, and Joaquim A Jorge. 2007. Shapeshop: Sketch-based solid modeling with blobtrees. In ACM SIGGRAPH 2007 courses. 43-es.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. The CGAL Project. 2021. CGAL User and Reference Manual (5.3 ed.). CGAL Editorial Board. https://doc.cgal.org/5.3/Manual/packages.htmlGoogle ScholarGoogle Scholar
  33. Jia Wang, Owen Leach, and Robert W. Lindeman. 2013. DIY World Builder: An immersive level-editing system. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). 195--196. https://doi.org/10.1109/3DUI.2013.6550245Google ScholarGoogle ScholarCross RefCross Ref
  34. Yunhai Wang, Shmulik Asafi, Oliver van Kaick, Hao Zhang, Daniel Cohen-Or, and Baoquan Chen. 2012. Active Co-Analysis of a Set of Shapes. ACM Trans. Graph. 31, 6, Article 165 (nov 2012), 10 pages. https://doi.org/10.1145/2366145.2366184Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Brian Wyvill, Andrew Guy, and Eric Galin. 1999. Extending the csg tree. warping, blending and boolean operations in an implicit surface modeling system. In Computer Graphics Forum, Vol. 18. Wiley Online Library, 149--158.Google ScholarGoogle Scholar
  36. Emilie Yu, Rahul Arora, Tibor Stanko, J. Andreas Bærentzen, Karan Singh, and Adrien Bousseau. 2021. CASSIE: Curve and Surface Sketching in Immersive Environments. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohoma, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3411764.3445158Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. EasyVRModeling: Easily Create 3D Models by an Immersive VR System

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Article Metrics

          • Downloads (Last 12 months)172
          • Downloads (Last 6 weeks)14

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!