Abstract
The latest innovations of VR make it possible to construct 3D models in a holographic immersive simulation environment. In this paper, we develop a user-friendly mid-air interactive modeling system named EasyVRModeling. We first prepare a dataset consisting of diverse components and precompute the discrete signed distance function (SDF) for each component. During the modeling phase, users can freely design complicated shapes with a pair of VR controllers. Based on the discrete SDF representation, any CSG-like operation (union, intersect, subtract) can be performed voxel-wise. Throughout the modeling process, we maintain one single dynamic SDF for the whole scene so that the zero-level set surface of the SDF exactly encodes the up-to-date constructed shape. Both SDF fusion and surface extraction are implemented via GPU to allow for smooth user experience. We asked 34 volunteers to create their favorite models using EasyVRModeling. With a simple training process for several minutes, most of them can create a fascinating shape or even a descriptive scene very quickly.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, EasyVRModeling: Easily Create 3D Models by an Immersive VR System
- Duncan Fraser Armin Rigo, Maciej Fijałkowski. 2020. version 16.0.0. Baroque Software. https://vrsketch.eu/Google Scholar
- Rahul Arora. 2020. Creative Expression with Immersive 3D Interactions. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3334480.3375028Google Scholar
Digital Library
- Rahul Arora and Karan Singh. 2021. Mid-Air Drawing of Curves on 3D Surfaces in Virtual Reality. ACM Transactions on Graphics (TOG) (2021).Google Scholar
- Andreas Bærentzen, Jeppe Revall Frisvad, and Karan Singh. 2019. Signifier-Based Immersive and Interactive 3D Modeling. In 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST '19). Association for Computing Machinery, New York, NY, USA, Article 18, 5 pages. https://doi.org/10.1145/3359996.3364257Google Scholar
Digital Library
- Lee Beever, Serban Pop, and Nigel W. John. 2020. LevelEd VR: A virtual reality level editor and workflow for virtual reality level design. In 2020 IEEE Conference on Games (CoG). 136--143. https://doi.org/10.1109/CoG47356.2020.9231769Google Scholar
Cross Ref
- Erin Cherry and Celine Latulipe. 2014. Quantifying the creativity support of digital tools through the creativity support index. ACM Transactions on Computer-Human Interaction (TOCHI) 21, 4 (2014), 1--25.Google Scholar
Digital Library
- Bruno Rodrigues De Araújo, Daniel S Lopes, Pauline Jepp, Joaquim A Jorge, and Brian Wyvill. 2015. A survey on implicit surface polygonization. ACM Computing Surveys (CSUR) 47, 4 (2015), 1--39.Google Scholar
Digital Library
- Josen Daniel O. De Leon, Romelio P. Tavas, Rodolfo A. Aranzanso, and Rowel O. Atienza. 2016. Genesys: A Virtual Reality scene builder. In 2016 IEEE Region 10 Conference (TENCON). 3708--3711. https://doi.org/10.1109/TENCON.2016.7848751Google Scholar
Cross Ref
- Tobias Drey, Jan Gugenheimer, Julian Karlbauer, Maximilian Milo, and Enrico Rukzio. 2020. VRSketchIn: Exploring the Design Space of Pen and Tablet Interaction for 3D Sketching in Virtual Reality. Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376628Google Scholar
Digital Library
- Zhongxiang Duan, Qin Yang, Xianhai Meng, and Jigang Li. 2020. Detailed Voxel-Based Implicit Modeling With Local Boolean Composition of Discrete Level Sets. IEEE Access 8 (2020), 48376--48385. https://doi.org/10.1109/ACCESS.2020.2979571Google Scholar
- Alex Evans. 2015. Learning from failure: a survey of promising, unconventional and mostly abandoned renderers for 'dreams ps4', a geometrically dense, painterly ugc game. Advances in Real-Time Rendering in Games. MediaMolecule, SIGGRAPH (2015).Google Scholar
- Stanley Osher Ronald Fedkiw and Stanley Osher. 2002. Level set methods and dynamic implicit surfaces. Surfaces 44, 77 (2002), 685.Google Scholar
- João Ferreira, Daniel Mendes, Rui Nóbrega, and Rui Rodrigues. 2021. Immersive Multimodal and Procedurally-Assisted Creation of VR Environments. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). 30--37. https://doi.org/10.1109/VRW52623.2021.00012Google Scholar
- Stefan Gottschalk, Ming C Lin, and Dinesh Manocha. 1996. OBBTree: A hierarchical structure for rapid interference detection. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. 171--180.Google Scholar
Digital Library
- Takeo Igarashi, Satoshi Matsuoka, and Hidehiko Tanaka. 2006. Teddy: a sketching interface for 3D freeform design. In ACM SIGGRAPH 2006 Courses. 11-es.Google Scholar
Digital Library
- Bret Jackson and Daniel F. Keefe. 2016. Lift-Off: Using Reference Imagery and Freehand Sketching to Create 3D Models in VR. IEEE Transactions on Visualization and Computer Graphics 22, 4 (2016), 1442--1451. https://doi.org/10.1109/TVCG.2016.2518099Google Scholar
Digital Library
- Jason Jerald and Richard Marks. 2016. Human-Centered Design for VR Interactions. In ACM SIGGRAPH 2016 Courses (Anaheim, California) (SIGGRAPH '16). Association for Computing Machinery, New York, NY, USA, Article 15, 60 pages. https://doi.org/10.1145/2897826.2927320Google Scholar
Digital Library
- Jason Jerald, Paul Mlyniec, Arun Yoganandan, Amir Rubin, Dan Paullus, and Simon Solotko. 2013. Makevr: A 3d world-building interface. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 197--198.Google Scholar
Cross Ref
- Leif P Kobbelt, Mario Botsch, Ulrich Schwanecke, and Hans-Peter Seidel. 2001. Feature sensitive surface extraction from volume data. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. 57--66.Google Scholar
Digital Library
- Eric Larsen, Stefan Gottschalk, Ming C Lin, and Dinesh Manocha. 1999. Fast proximity queries with swept sphere volumes. Technical Report.Google Scholar
- Thomas Lewiner, Hélio Lopes, Antônio Wilson Vieira, and Geovan Tavares. 2003. Efficient implementation of marching cubes' cases with topological guarantees. Journal of graphics tools 8, 2 (2003), 1--15.Google Scholar
Cross Ref
- Yong-Jin Liu, Cui-Xia Ma, and Dong-Liang Zhang. 2011. EasyToy: Plush Toy Design Using Editable Sketching Curves. IEEE Computer Graphics and Applications 31, 2 (2011), 49--57. https://doi.org/10.1109/MCG.2009.147Google Scholar
Digital Library
- Pedro Lopes, Daniel Mendes, Bruno Araújo, and Joaquim A Jorge. 2011. Combining bimanual manipulation and pen-based input for 3d modelling. In Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling. 15--22.Google Scholar
Digital Library
- William E Lorensen and Harvey E Cline. 1987. Marching cubes: A high resolution 3D surface construction algorithm. ACM siggraph computer graphics 21, 4 (1987), 163--169.Google Scholar
- Tim McInemey and Demetri Terzopoulos. 1999. Topology adaptive deformable surfaces for medical image volume segmentation. IEEE transactions on medical imaging 18, 10 (1999), 840--850.Google Scholar
- Daniel Mendes, Daniel Medeiros, Maurício Sousa, Ricardo Ferreira, Alberto Raposo, Alfredo Ferreira, and Joaquim Jorge. 2017. Mid-air modeling with Boolean operations in VR. In 2017 IEEE Symposium on 3D User Interfaces (3DUI). 154--157. https://doi.org/10.1109/3DUI.2017.7893332Google Scholar
Cross Ref
- Timothy S Newman and Hong Yi. 2006. A survey of the marching cubes algorithm. Computers & Graphics 30, 5 (2006), 854--879.Google Scholar
Cross Ref
- Stanley Osher and Ronald Fedkiw. 2006. Level set methods and dynamic implicit surfaces. Vol. 153. Springer Science & Business Media.Google Scholar
- Alexander Pasko, Valery Adzhiev, Alexei Sourin, and Vladimir Savchenko. 1995. Function representation in geometric modeling: concepts, implementation and applications. The visual computer 11, 8 (1995), 429--446.Google Scholar
- Mengqi Peng, Jun Xing, and Li Yi Wei. 2018. Autocomplete 3D sculpting. ACM Transactions on Graphics (TOG) (2018).Google Scholar
- Ryan Schmidt, Brian Wyvill, Mario Costa Sousa, and Joaquim A Jorge. 2007. Shapeshop: Sketch-based solid modeling with blobtrees. In ACM SIGGRAPH 2007 courses. 43-es.Google Scholar
Digital Library
- The CGAL Project. 2021. CGAL User and Reference Manual (5.3 ed.). CGAL Editorial Board. https://doc.cgal.org/5.3/Manual/packages.htmlGoogle Scholar
- Jia Wang, Owen Leach, and Robert W. Lindeman. 2013. DIY World Builder: An immersive level-editing system. In 2013 IEEE Symposium on 3D User Interfaces (3DUI). 195--196. https://doi.org/10.1109/3DUI.2013.6550245Google Scholar
Cross Ref
- Yunhai Wang, Shmulik Asafi, Oliver van Kaick, Hao Zhang, Daniel Cohen-Or, and Baoquan Chen. 2012. Active Co-Analysis of a Set of Shapes. ACM Trans. Graph. 31, 6, Article 165 (nov 2012), 10 pages. https://doi.org/10.1145/2366145.2366184Google Scholar
Digital Library
- Brian Wyvill, Andrew Guy, and Eric Galin. 1999. Extending the csg tree. warping, blending and boolean operations in an implicit surface modeling system. In Computer Graphics Forum, Vol. 18. Wiley Online Library, 149--158.Google Scholar
- Emilie Yu, Rahul Arora, Tibor Stanko, J. Andreas Bærentzen, Karan Singh, and Adrien Bousseau. 2021. CASSIE: Curve and Surface Sketching in Immersive Environments. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohoma, Japan) (CHI '21). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3411764.3445158Google Scholar
Digital Library
Index Terms
EasyVRModeling: Easily Create 3D Models by an Immersive VR System
Recommendations
QuickCSGModeling: Quick CSG Operations Based on Fusing Signed Distance Fields for VR Modeling
The latest advancements in Virtual Reality(VR) enable the creation of 3D models within a holographic immersive simulation environment. In this paper, we create QuickCSGModeling, a user-friendly mid-air interactive modeling system. We first prepare a ...
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
Natural Perspective Projections for Head-Mounted Displays
The display units integrated in today's head-mounted displays (HMDs) provide only a limited field of view (FOV) to the virtual world. In order to present an undistorted view to the virtual environment (VE), the perspective projection used to render the ...






Comments