Haoxiang Guo
Yang Liu
Skip Abstract Section
Skip Supplemental Material SectionAbstract
We view the reconstruction of CAD models in the boundary representation (B-Rep) as the detection of geometric primitives of different orders, i.e., vertices, edges and surface patches, and the correspondence of primitives, which are holistically modeled as a chain complex, and show that by modeling such comprehensive structures more complete and regularized reconstructions can be achieved. We solve the complex generation problem in two steps. First, we propose a novel neural framework that consists of a sparse CNN encoder for input point cloud processing and a tri-path transformer decoder for generating geometric primitives and their mutual relationships with estimated probabilities. Second, given the probabilistic structure predicted by the neural network, we recover a definite B-Rep chain complex by solving a global optimization maximizing the likelihood under structural validness constraints and applying geometric refinements. Extensive tests on large scale CAD datasets demonstrate that the modeling of B-Rep chain complex structure enables more accurate detection for learning and more constrained reconstruction for optimization, leading to structurally more faithful and complete CAD B-Rep models than previous results.
Supplemental Material
Available for Download
- 3D Systems Inc. 2021. Geomagic Design X. https://www.3dsystems.com/software/geomagic-design-x Accessed Apr. 20, 2021.Google Scholar
- James Andrews and Carlo H. Séquin. 2013. Type-Constrained Direct Fitting of Quadric Surfaces. Computer Aided Design and Applications (2013).Google Scholar
- Kurt M Anstreicher. 2003. Recent advances in the solution of quadratic assignment problems. Mathematical Programming 97, 1 (2003), 27--42.Google ScholarCross Ref
- Ansys Inc. 2021. Ansys SpaceClaim. https://www.ansys.com/products/3d-design/ansys-spaceclaim Accessed Apr. 20, 2021.Google Scholar
- Autodesk Inc. 2021. AutoCAD. http://www.autodesk.com/products/autocad/overview Accessed Apr. 20, 2021.Google Scholar
- Matthew Berger, Andrea Tagliasacchi, Lee M. Seversky, Pierre Alliez, Gaël Guennebaud, Joshua A. Levine, Andrei Sharf, and Claudio T. Silva. 2017. A Survey of Surface Reconstruction from Point Clouds. Computer Graphics Forum 36, 1 (2017).Google Scholar
- Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. 2020. End-to-end object detection with transformers. In European Conference on Computer Vision. Springer.Google ScholarDigital Library
- Dan Cascaval, Mira Shalah, Phillip Quinn, Rastislav Bodik, Maneesh Agrawala, and Adriana Schulz. 2021. Differentiable 3D CAD Programs for Bidirectional Editing. arXiv preprint arXiv:2110.01182 (2021).Google Scholar
- Angel X. Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, Jianxiong Xiao, Li Yi, and Fisher Yu. 2015. ShapeNet: An Information-Rich 3D Model Repository. Technical Report arXiv:1512.03012 [cs.GR]. Stanford University --- Princeton University --- Toyota Technological Institute at Chicago.Google Scholar
- Christopher Choy, JunYoung Gwak, and Silvio Savarese. 2019. 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google ScholarCross Ref
- David Cohen-Steiner, Pierre Alliez, and Mathieu Desbrun. 2004. Variational Shape Approximation. In ACM SIGGRAPH 2004 Papers (SIGGRAPH '04). Association for Computing Machinery, 10 pages.Google Scholar
- Antonio DiCarlo, Alberto Paoluzzi, and Vadim Shapiro. 2014. Linear algebraic representation for topological structures. Computer-Aided Design 46 (2014).Google Scholar
- Tao Du, Jeevana Priya Inala, Yewen Pu, Andrew Spielberg, Adriana Schulz, Daniela Rus, Armando Solar-Lezama, and Wojciech Matusik. 2018. InverseCSG: Automatic Conversion of 3D Models to CSG Trees. ACM Trans. Graph. (Siggraph Asia) 37, 6, Article 213 (2018).Google Scholar
- Yaroslav Ganin, Sergey Bartunov, Yujia Li, Ethan Keller, and Stefano Saliceti. 2021. Computer-Aided Design as Language. In Advances in Neural Information Processing Systems, Vol. 34. Curran Associates, Inc.Google Scholar
- Gurobi Optimization, LLC. 2021. Gurobi Optimizer Reference Manual. https://www.gurobi.comGoogle Scholar
- David Ha, Andrew Dai, and Quoc V. Le. 2017. HyperNetworks. In ICLR.Google Scholar
- Allen Hatcher. 2002. Algebraic Topology. Cambridge Univ. Press, Cambridge.Google Scholar
- Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. 2017. Mask R-CNN. In IEEE International Conference on Computer Vision (ICCV).Google Scholar
- Christoph Martin Hoffmann. 1989. Geometric and Solid Modeling: An Introduction. Morgan Kaufmann.Google Scholar
- Jingwei Huang, Yanfeng Zhang, and Mingwei Sun. 2021. PrimitiveNet: Primitive Instance Segmentation With Local Primitive Embedding Under Adversarial Metric. In IEEE/CVF International Conference on Computer Vision (ICCV). 15343--15353.Google Scholar
- Pradeep Kumar Jayaraman, Aditya Sanghi, Joseph G. Lambourne, Karl D.D. Willis, Thomas Davies, Hooman Shayani, and Nigel Morris. 2021. UV-Net: Learning from Boundary Representations. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google ScholarCross Ref
- Kacper Kania, Maciej Zięba, and Tomasz Kajdanowicz. 2020. UCSG-NET- Unsupervised Discovering of Constructive Solid Geometry Tree. In Advances in Neural Information Processing Systems, Vol. 33. Curran Associates, Inc.Google Scholar
- Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations (ICLR).Google Scholar
- Sebastian Koch, Albert Matveev, Zhongshi Jiang, Francis Williams, Alexey Artemov, Evgeny Burnaev, Marc Alexa, Denis Zorin, and Daniele Panozzo. 2019. Abc: A big cad model dataset for geometric deep learning. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google ScholarCross Ref
- Harold W. Kuhn. 1955. The Hungarian method for the assignment problem. Naval Research Logistics Quarterly 2 (1955), 83--97.Google ScholarCross Ref
- Joseph G. Lambourne, Karl D.D. Willis, Pradeep Kumar Jayaraman, Aditya Sanghi, Peter Meltzer, and Hooman Shayani. 2021. BRepNet: A Topological Message Passing System for Solid Models. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Lingxiao Li, Minhyuk Sung, Anastasia Dubrovina, Li Yi, and Leonidas J. Guibas. 2019. Supervised Fitting of Geometric Primitives to 3D Point Clouds. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Yangyan Li, Xiaokun Wu, Yiorgos Chrysathou, Andrei Sharf, Daniel Cohen-Or, and Niloy J. Mitra. 2011. GlobFit: Consistently Fitting Primitives by Discovering Global Relations. ACM Trans. Graph. (SIGGRAPH) 30, 4 (2011).Google ScholarDigital Library
- Yujia Liu, Stefano D'Aronco, Konrad Schindler, and Jan Dirk Wegner. 2021. PC2WF: 3D Wireframe Reconstruction from Raw Point Clouds. In International Conference on Learning Representations.Google Scholar
- Aman Mathur and Damien Zufferey. 2021. Constraint Synthesis for Parametric CAD. In Pacific Graphics Short Papers, Posters, and work-in-Progress Papers. The Eurographics Association.Google Scholar
- Depu Meng, Xiaokang Chen, Zejia Fan, Gang Zeng, Houqiang Li, Yuhui Yuan, Lei Sun, and Jingdong Wang. 2021. Conditional DETR for Fast Training Convergence. In IEEE International Conference on Computer Vision (ICCV).Google Scholar
- Ishan Misra, Rohit Girdhar, and Armand Joulin. 2021. An End-to-End Transformer Model for 3D Object Detection. In IEEE International Conference on Computer Vision (ICCV).Google ScholarCross Ref
- James Munkres. 1957. Algorithms for the Assignment and Transportation Problems. J. Soc. Indust. Appl. Math. 5, 1 (1957), 32--38.Google ScholarCross Ref
- Liangliang Nan and Peter Wonka. 2017. PolyFit: Polygonal Surface Reconstruction From Point Clouds. In IEEE Conference on Computer Vision (ICCV).Google Scholar
- Charlie Nash, Yaroslav Ganin, SM Ali Eslami, and Peter Battaglia. 2020. Polygen: An autoregressive generative model of 3d meshes. In International Conference on Machine Learning. PMLR.Google Scholar
- Wamiq Para, Shariq Bhat, Paul Guerrero, Tom Kelly, Niloy Mitra, Leonidas J Guibas, and Peter Wonka. 2021. SketchGen: Generating Constrained CAD Sketches. In Advances in Neural Information Processing Systems, Vol. 34. Curran Associates, Inc.Google Scholar
- Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You Only Look Once: Unified, Real-Time Object Detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Daxuan Ren, Jianmin Zheng, Jianfei Cai, Jiatong Li, Haiyong Jiang, Zhongang Cai, Junzhe Zhang, Liang Pan, Mingyuan Zhang, Haiyu Zhao, et al. 2021. CSG-Stump: A Learning Friendly CSG-Like Representation for Interpretable Shape Parsing. In IEEE International Conference on Computer Vision (ICCV).Google Scholar
- Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2017. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 39, 6 (2017).Google ScholarDigital Library
- Ruwen Schnabel, Patrick Degener, and Reinhard Klein. 2009. Completion and Reconstruction with Primitive Shapes. Computer Graphics Forum 28, 2 (2009).Google Scholar
- Ruwen Schnabel, Roland Wahl, and Reinhard Klein. 2007. Efficient RANSAC for Point-Cloud Shape Detection. Computer Graphics Forum 26, 2 (2007).Google Scholar
- Philip Schneider and David H. Eberly. 2003. Geometric Tools for Computer Graphics. Morgan Kaufmann.Google Scholar
- Ari Seff, Yaniv Ovadia, Wenda Zhou, and Ryan P. Adams. 2020. SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Design. In ICML 2020 Workshop on Object-Oriented Learning.Google Scholar
- Ari Seff, Wenda Zhou, Nick Richardson, and Ryan P Adams. 2021. Vitruvion: A Generative Model of Parametric CAD Sketches. arXiv preprint arXiv:2109.14124 (2021).Google Scholar
- Gopal Sharma, Rishabh Goyal, Difan Liu, Evangelos Kalogerakis, and Subhransu Maji. 2018. CSGNet: Neural Shape Parser for Constructive Solid Geometry. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Gopal Sharma, Difan Liu, Subhransu Maji, Evangelos Kalogerakis, Siddhartha Chaudhuri, and Radomír Měch. 2020. ParSeNet: A Parametric Surface Fitting Network for 3D Point Clouds. In European Conference on Computer Vision.Google ScholarDigital Library
- Martin Skrodzki, Eric Zimmermann, and Konrad Polthier. 2020. Variational shape approximation of point set surfaces. Computer Aided Geometric Design 80 (2020).Google Scholar
- Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, Vol. 30. Curran Associates, Inc.Google Scholar
- Xiaogang Wang, Yuelang Xu, Kai Xu, Andrea Tagliasacchi, Bin Zhou, Ali Mahdavi-Amiri, and Hao Zhang. 2020. PIE-NET: Parametric Inference of Point Cloud Edges. In Neural Information Processing Systems.Google Scholar
- Kevin J. Weiler. 1986. Topological Structures for Geometric Modeling. Rensselaer Polytechnic Institute.Google Scholar
- Naoufel Werghi, Robert Fisher, Anthony Ashbrook, and Craig Robertson. 2002. Shape Reconstruction Incorporating Multiple Nonlinear Geometric Constraints. Constraints 7 (04 2002).Google Scholar
- Karl D. D. Willis, Pradeep Kumar Jayaraman, Hang Chu, Yunsheng Tian, Yifei Li, Daniele Grandi, Aditya Sanghi, Linh Tran, J. Lambourne, Armando Solar-Lezama, and Wojciech Matusik. 2021a. JoinABLe: Learning Bottom-up Assembly of Parametric CAD Joints. ArXiv abs/2111.12772 (2021).Google Scholar
- Karl D. D. Willis, Pradeep Kumar Jayaraman, Joseph G. Lambourne, Hang Chu, and Yewen Pu. 2021b. Engineering Sketch Generation for Computer-Aided Design. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).Google Scholar
- Karl D. D. Willis, Yewen Pu, Jieliang Luo, Hang Chu, Tao Du, Joseph G. Lambourne, Armando Solar-Lezama, and Wojciech Matusik. 2021c. Fusion 360 Gallery: A Dataset and Environment for Programmatic CAD Construction from Human Design Sequences. ACM Transactions on Graphics (TOG) 40, 4 (2021).Google ScholarDigital Library
- Rundi Wu, Chang Xiao, and Changxi Zheng. 2021. DeepCAD: A Deep Generative Network for Computer-Aided Design Models. In IEEE International Conference on Computer Vision (ICCV).Google Scholar
- Ruibin Xiong, Yunchang Yang, Di He, Kai Zheng, Shuxin Zheng, Chen Xing, Huishuai Zhang, Yanyan Lan, Liwei Wang, and Tieyan Liu. 2020. On Layer Normalization in the Transformer Architecture. In International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 119). PMLR.Google Scholar
- Xianghao Xu, Wenzhe Peng, Chin-Yi Cheng, Karl D. D. Willis, and Daniel Ritchie. 2021. Inferring CAD Modeling Sequences Using Zone Graphs. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Dong-Ming Yan, Wenping Wang, Yang Liu, and Zhouwang Yang. 2012. Variational mesh segmentation via quadric surface fitting. Computer-Aided Design 44, 11 (2012).Google Scholar
- Siming Yan, Zhenpei Yang, Chongyang Ma, Haibin Huang, Etienne Vouga, and Qixing Huang. 2021. HPNet: Deep Primitive Segmentation Using Hybrid Representations. International Conference on Computer Vision (ICCV).Google Scholar
- Dominic Zhao, Johannes von Oswald, Seijin Kobayashi, João Sacramento, and Benjamin F Grewe. 2020. Meta-Learning via Hypernetworks. In Workshop on Meta-Learning at NeurIPS 2020 (MetaLearn 2020). IEEE.Google Scholar
Index Terms
ComplexGen: CAD reconstruction by B-rep chain complex generation
Recommendations
Spherical Conformal Parameterization of Genus-0 Point Clouds for Meshing
The point cloud is the most fundamental representation of three-dimensional geometric objects. Analyzing and processing point cloud surfaces is important in computer graphics and computer vision. However, most of the existing algorithms for surface ...
Computing refined skeletal features from medial point clouds
We present methods for computing refined features from 3D medial-surface point clouds.Features include: medial point classification, medial surface decomposition into sheets, Y-network extraction, and robust regularization.We compute our refined ...
Tomographic surface reconstruction from point cloud
Inspired by computed tomography (CT), this paper presents a novel surface reconstruction algorithm, tomographic surface reconstruction, to reconstruct a surface mesh from a point cloud equipped with oriented normals. In the process of scanning a real ...
Comments